2026-03-30 11:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 11:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 11:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-30 11:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-30 11:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 11:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 11:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 11:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 11:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: 17695154b3a2cb03
2026-03-30 11:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 11:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-30T11_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 11:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 11:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 11:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-30 11:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 11:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 11:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 11:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 11:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 11:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 11:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 11:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:06 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 1 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 150MiB
2026-03-30 11:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 11:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 11:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 11:36:27 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1754 | hits on page: 40
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: YJ65498
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: FU90120
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU90120%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for FU90120: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: XW70859
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: GM15031
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: LP20527
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP20527%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for LP20527: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: BR51057
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR51057%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for BR51057: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: NA05180
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA05180%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for NA05180: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: RX63539
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: CC31408
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: FB83795
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB83795%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for FB83795: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: KR73371
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR73371%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for KR73371: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: AY86214
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY86214%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for AY86214: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: BZ56552
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: NC36206
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC36206%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for NC36206: 1
2026-03-30 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: DP60606
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP60606%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for DP60606: 1
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: UF96897
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF96897%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for UF96897: 1
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: EU06132
2026-03-30 11:36:27 [auto1.be] INFO: Found listing with ID: PT50790
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT50790%27 HTTP/1.1" 200 None
2026-03-30 11:36:27 [auto1.be] INFO: Scrape type for PT50790: 2
2026-03-30 11:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 896aa4b1-0768-5b55-974f-e203eb95883f with identifier: PT50790
2026-03-30 11:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896aa4b1-0768-5b55-974f-e203eb95883f with scrape type 2
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 896aa4b1-0768-5b55-974f-e203eb95883f with scrape type 2
2026-03-30 11:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 896aa4b1-0768-5b55-974f-e203eb95883f, identifier: PT50790
2026-03-30 11:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 896aa4b1-0768-5b55-974f-e203eb95883f with identifier: PT50790
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 11:36:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 11:36:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 896aa4b1-0768-5b55-974f-e203eb95883f with identifier: PT50790
2026-03-30 11:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 896aa4b1-0768-5b55-974f-e203eb95883f with identifier: PT50790 to the API
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:52:15Z',
 'fuel_type': 'petrol',
 'id': '896aa4b1-0768-5b55-974f-e203eb95883f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT50790',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 148933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-24',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2007}
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT50790%27 HTTP/1.1" 200 None
2026-03-30 11:36:28 [auto1.be] INFO: Saving data for PT50790: {'auction_closing_time': 1774972335.0, 'created_time': 1773134959.186711, 'last_price_update_time': 1774870588.612854}
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PT50790') HTTP/1.1" 204 0
2026-03-30 11:36:28 [auto1.be] INFO: Found listing with ID: HX83389
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX83389%27 HTTP/1.1" 200 None
2026-03-30 11:36:28 [auto1.be] INFO: Scrape type for HX83389: 1
2026-03-30 11:36:28 [auto1.be] INFO: Found listing with ID: PA62329
2026-03-30 11:36:28 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-30 11:36:28 [auto1.be] INFO: Scrape type for MD92482: 2
2026-03-30 11:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482
2026-03-30 11:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b144b57b-f96f-5fc4-b3db-37f849469388 with scrape type 2
2026-03-30 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b144b57b-f96f-5fc4-b3db-37f849469388 with scrape type 2
2026-03-30 11:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b144b57b-f96f-5fc4-b3db-37f849469388, identifier: MD92482
2026-03-30 11:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 11:36:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 11:36:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482
2026-03-30 11:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482 to the API
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:16:37Z',
 'fuel_type': 'diesel',
 'id': 'b144b57b-f96f-5fc4-b3db-37f849469388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD92482',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 197173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-30 11:36:29 [auto1.be] INFO: Saving data for MD92482: {'auction_closing_time': 1774970197.0, 'created_time': 1774514151.919334, 'last_price_update_time': 1774870589.450871}
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD92482') HTTP/1.1" 204 0
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: ME23614
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME23614%27 HTTP/1.1" 200 None
2026-03-30 11:36:29 [auto1.be] INFO: Scrape type for ME23614: 1
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: NT28304
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT28304%27 HTTP/1.1" 200 None
2026-03-30 11:36:29 [auto1.be] INFO: Scrape type for NT28304: 2
2026-03-30 11:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33bc9ade-cad8-54ef-aea4-413f33d1c616 with identifier: NT28304
2026-03-30 11:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33bc9ade-cad8-54ef-aea4-413f33d1c616 with scrape type 2
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33bc9ade-cad8-54ef-aea4-413f33d1c616 with scrape type 2
2026-03-30 11:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 33bc9ade-cad8-54ef-aea4-413f33d1c616, identifier: NT28304
2026-03-30 11:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 33bc9ade-cad8-54ef-aea4-413f33d1c616 with identifier: NT28304
2026-03-30 11:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 33bc9ade-cad8-54ef-aea4-413f33d1c616 with identifier: NT28304
2026-03-30 11:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 33bc9ade-cad8-54ef-aea4-413f33d1c616 with identifier: NT28304 to the API
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:53:35Z',
 'fuel_type': 'diesel',
 'id': '33bc9ade-cad8-54ef-aea4-413f33d1c616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT28304',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 131161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-04',
 'seller_name': None,
 'title': 'Audi TT 2.0 TDI quattro. Roadster',
 'transmission': 'automatic',
 'trim': 'quattro. Roadster',
 'year': 2012}
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT28304%27 HTTP/1.1" 200 None
2026-03-30 11:36:29 [auto1.be] INFO: Saving data for NT28304: {'auction_closing_time': 1774972415.0, 'created_time': 1774125333.2636, 'last_price_update_time': 1774870589.931482}
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NT28304') HTTP/1.1" 204 0
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: KE14045
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: HX20091
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: JF63760
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: GZ81291
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: SG12556
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: HH54390
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: GE72879
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: AT59438
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: UL07938
2026-03-30 11:36:29 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-30 11:36:29 [auto1.be] INFO: Scrape type for JR35998: 2
2026-03-30 11:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998
2026-03-30 11:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with scrape type 2
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with scrape type 2
2026-03-30 11:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a, identifier: JR35998
2026-03-30 11:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998
2026-03-30 11:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998
2026-03-30 11:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a with identifier: JR35998 to the API
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:41:18Z',
 'fuel_type': 'diesel',
 'id': 'd1cbbab6-9db5-5fb5-ae7d-b259e9c40d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR35998',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 200690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-30',
 'seller_name': None,
 'title': 'BMW 7er 730d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [auto1.be] INFO: Saving data for JR35998: {'auction_closing_time': 1774971678.0, 'created_time': 1773239529.755243, 'last_price_update_time': 1774870590.40137}
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JR35998') HTTP/1.1" 204 0
2026-03-30 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA05180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:30 [auto1.be] INFO: Found listing with ID: YV19532
2026-03-30 11:36:30 [auto1.be] INFO: Found listing with ID: JA94811
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA94811%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [auto1.be] INFO: Scrape type for JA94811: 1
2026-03-30 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:30 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [auto1.be] INFO: Scrape type for LT82149: 2
2026-03-30 11:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149
2026-03-30 11:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with scrape type 2
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with scrape type 2
2026-03-30 11:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3, identifier: LT82149
2026-03-30 11:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149
2026-03-30 11:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149 to the API
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:34:32Z',
 'fuel_type': 'petrol',
 'id': '22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT82149',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 67628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-30 11:36:31 [auto1.be] INFO: Saving data for LT82149: {'auction_closing_time': 1774971272.0, 'created_time': 1774514143.724477, 'last_price_update_time': 1774870591.204287}
2026-03-30 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT82149') HTTP/1.1" 204 0
2026-03-30 11:36:31 [auto1.be] INFO: Found listing with ID: WS04196
2026-03-30 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04196%27 HTTP/1.1" 200 None
2026-03-30 11:36:31 [auto1.be] INFO: Scrape type for WS04196: 2
2026-03-30 11:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb420fd0-aa98-5ee2-9cfb-aebd6f663727 with identifier: WS04196
2026-03-30 11:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb420fd0-aa98-5ee2-9cfb-aebd6f663727 with scrape type 2
2026-03-30 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb420fd0-aa98-5ee2-9cfb-aebd6f663727 with scrape type 2
2026-03-30 11:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb420fd0-aa98-5ee2-9cfb-aebd6f663727, identifier: WS04196
2026-03-30 11:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb420fd0-aa98-5ee2-9cfb-aebd6f663727 with identifier: WS04196
2026-03-30 11:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb420fd0-aa98-5ee2-9cfb-aebd6f663727 with identifier: WS04196
2026-03-30 11:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb420fd0-aa98-5ee2-9cfb-aebd6f663727 with identifier: WS04196 to the API
2026-03-30 11:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:21:57Z',
 'fuel_type': 'petrol',
 'id': 'bb420fd0-aa98-5ee2-9cfb-aebd6f663727',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS04196',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 86623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Basis +',
 'transmission': 'manual',
 'trim': 'Basis +',
 'year': 2011}
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04196%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.be] INFO: Saving data for WS04196: {'auction_closing_time': 1774970517.0, 'created_time': 1773403080.835584, 'last_price_update_time': 1774870592.457846}
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WS04196') HTTP/1.1" 204 0
2026-03-30 11:36:32 [auto1.be] INFO: Found listing with ID: YW96684
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96684%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.be] INFO: Scrape type for YW96684: 1
2026-03-30 11:36:32 [auto1.be] INFO: Found listing with ID: TL11462
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL11462%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.be] INFO: Scrape type for TL11462: 1
2026-03-30 11:36:32 [auto1.be] INFO: Found listing with ID: ZF22511
2026-03-30 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB83795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR51057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:33 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1754 | hits on page: 40
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: YJ65498
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: FU90120
2026-03-30 11:36:33 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/FU90120/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: XW70859
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: GM15031
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: LP20527
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: BR51057
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: NA05180
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: RX63539
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: CC31408
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: FB83795
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: KR73371
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: AY86214
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: BZ56552
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: NC36206
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: DP60606
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: UF96897
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: EU06132
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: PT50790
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT50790%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.be] INFO: Scrape type for PT50790: 0
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: HX83389
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: PA62329
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.be] INFO: Scrape type for MD92482: 0
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: ME23614
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: NT28304
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT28304%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.be] INFO: Scrape type for NT28304: 0
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: KE14045
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: HX20091
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: JF63760
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: GZ81291
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: SG12556
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: HH54390
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: GE72879
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: AT59438
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: UL07938
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.be] INFO: Scrape type for JR35998: 0
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: YV19532
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: JA94811
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.be] INFO: Scrape type for LT82149: 0
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: WS04196
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04196%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.be] INFO: Scrape type for WS04196: 0
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: YW96684
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: TL11462
2026-03-30 11:36:33 [auto1.be] INFO: Found listing with ID: ZF22511
2026-03-30 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX83389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF96897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP60606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY86214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA94811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL11462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME23614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA05180> (referer: https://www.auto1.com/v1/car-details-view/NA05180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aa55991-76e9-5eef-ae5c-46e333a47d8e with identifier: NA05180
2026-03-30 11:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e with scrape type 1
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_d3548f5913ad3a4f74c51ef7041cd9b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_d3548f5913ad3a4f74c51ef7041cd9b4.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_fde44ed9e07705c0338a0e3bf9c6f694.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_fde44ed9e07705c0338a0e3bf9c6f694.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_04a4b066304bd67527c29008fa0e40c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_04a4b066304bd67527c29008fa0e40c4.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_946ba5aeea76677890ca3a92f2708362.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_946ba5aeea76677890ca3a92f2708362.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_f9634e2fcd8aeb7ed10fff1ab6d67fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f9634e2fcd8aeb7ed10fff1ab6d67fc7.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_0c949a7e280bdd07874cd5bd7a3d1bba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_0c949a7e280bdd07874cd5bd7a3d1bba.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_c3504e5fdd00e2b8c20db76a40674bc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_c3504e5fdd00e2b8c20db76a40674bc1.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_f4f5a373e1c4cd503472da69dae01961.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f4f5a373e1c4cd503472da69dae01961.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_abe8a0e9c361c348d4ae909fee4198c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_abe8a0e9c361c348d4ae909fee4198c8.jpg not downloaded yet
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_6ed087a5800d0308883215581a564767.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_6ed087a5800d0308883215581a564767.jpg not downloaded yet
2026-03-30 11:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_d3548f5913ad3a4f74c51ef7041cd9b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_6ed087a5800d0308883215581a564767.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_abe8a0e9c361c348d4ae909fee4198c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 11:37:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 11:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc997c50>
2026-03-30 11:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_d3548f5913ad3a4f74c51ef7041cd9b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_d3548f5913ad3a4f74c51ef7041cd9b4.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f4f5a373e1c4cd503472da69dae01961.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc94ad10>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_6ed087a5800d0308883215581a564767.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_6ed087a5800d0308883215581a564767.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8384d0>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_abe8a0e9c361c348d4ae909fee4198c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_abe8a0e9c361c348d4ae909fee4198c8.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83eb10>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_f4f5a373e1c4cd503472da69dae01961.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f4f5a373e1c4cd503472da69dae01961.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_c3504e5fdd00e2b8c20db76a40674bc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_0c949a7e280bdd07874cd5bd7a3d1bba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f9634e2fcd8aeb7ed10fff1ab6d67fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_946ba5aeea76677890ca3a92f2708362.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc817a50>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_c3504e5fdd00e2b8c20db76a40674bc1.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_c3504e5fdd00e2b8c20db76a40674bc1.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_04a4b066304bd67527c29008fa0e40c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de81be10>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_0c949a7e280bdd07874cd5bd7a3d1bba.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_0c949a7e280bdd07874cd5bd7a3d1bba.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81f690>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_f9634e2fcd8aeb7ed10fff1ab6d67fc7.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f9634e2fcd8aeb7ed10fff1ab6d67fc7.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_fde44ed9e07705c0338a0e3bf9c6f694.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc993310>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_946ba5aeea76677890ca3a92f2708362.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_946ba5aeea76677890ca3a92f2708362.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0e050>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_04a4b066304bd67527c29008fa0e40c4.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_04a4b066304bd67527c29008fa0e40c4.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc974f90>
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fce%252F43ceccd46989e6bb7b7cf08ea8f9d1e8%252Fpa%252FNA05180_fde44ed9e07705c0338a0e3bf9c6f694.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_fde44ed9e07705c0338a0e3bf9c6f694.jpg saved to cache
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e
2026-03-30 11:37:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5aa55991-76e9-5eef-ae5c-46e333a47d8e, skipping ID generation
2026-03-30 11:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e with scrape type 1
2026-03-30 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5aa55991-76e9-5eef-ae5c-46e333a47d8e sending to next pipeline
2026-03-30 11:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5aa55991-76e9-5eef-ae5c-46e333a47d8e, identifier: NA05180
2026-03-30 11:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5aa55991-76e9-5eef-ae5c-46e333a47d8e with identifier: NA05180
2026-03-30 11:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 11:37:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 11:37:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5aa55991-76e9-5eef-ae5c-46e333a47d8e with identifier: NA05180
2026-03-30 11:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5aa55991-76e9-5eef-ae5c-46e333a47d8e with identifier: NA05180 to the API
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_fde44ed9e07705c0338a0e3bf9c6f694.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:40:52Z',
 'fuel_type': 'hybrid',
 'id': '5aa55991-76e9-5eef-ae5c-46e333a47d8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA05180',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '2er',
 'odometer': 73683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_d3548f5913ad3a4f74c51ef7041cd9b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_fde44ed9e07705c0338a0e3bf9c6f694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_04a4b066304bd67527c29008fa0e40c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_946ba5aeea76677890ca3a92f2708362.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f9634e2fcd8aeb7ed10fff1ab6d67fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_0c949a7e280bdd07874cd5bd7a3d1bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_c3504e5fdd00e2b8c20db76a40674bc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_f4f5a373e1c4cd503472da69dae01961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_abe8a0e9c361c348d4ae909fee4198c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5aa55991-76e9-5eef-ae5c-46e333a47d8e/5aa55991-76e9-5eef-ae5c-46e333a47d8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/ce/43ceccd46989e6bb7b7cf08ea8f9d1e8/pa/NA05180_6ed087a5800d0308883215581a564767.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA05180%27 HTTP/1.1" 200 None
2026-03-30 11:37:07 [auto1.be] INFO: Saving data for NA05180: {'created_time': 1774870627.685708, 'last_price_update_time': 1774870627.68572, 'auction_closing_time': 1774971652.0}
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NA05180') HTTP/1.1" 204 0
2026-03-30 11:37:07 [scrapy.extensions.logstats] INFO: Crawled 16 pages (at 15 pages/min), scraped 7 items (at 7 items/min)
2026-03-30 11:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 11:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB83795> (referer: https://www.auto1.com/v1/car-details-view/FB83795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8434ef2-4001-547b-9f07-e62d1b46ad1a with identifier: FB83795
2026-03-30 11:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8434ef2-4001-547b-9f07-e62d1b46ad1a with scrape type 1
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8434ef2-4001-547b-9f07-e62d1b46ad1a
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_7323d3733a0d983863857fd3a09905ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7323d3733a0d983863857fd3a09905ad.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_7dc819f4435e49a56738fd1550acec8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7dc819f4435e49a56738fd1550acec8f.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_7313931e9d2c64ab7b62f63c385e9eb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7313931e9d2c64ab7b62f63c385e9eb4.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_4c68f8ca73076bc7dd663ef65293c3fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_4c68f8ca73076bc7dd663ef65293c3fe.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_b5a2becc21e009cf27222f68f1ce58e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_b5a2becc21e009cf27222f68f1ce58e9.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_8c08f265a47d69b79362ab4accbf09ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_8c08f265a47d69b79362ab4accbf09ed.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_ed0a373143d944b5383e98e29687126a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_ed0a373143d944b5383e98e29687126a.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_2d3b93c891cf54bc272c993ba533c08f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_2d3b93c891cf54bc272c993ba533c08f.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_6ef5536378cae368f354c972c332abed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_6ef5536378cae368f354c972c332abed.jpg already downloaded
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F56%252F3156bdc50154901288af10c8940fc50b%252Fpa%252FFB83795_6a527319e203fa0348b82e9e85e54cbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_6a527319e203fa0348b82e9e85e54cbe.jpg already downloaded
2026-03-30 11:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8434ef2-4001-547b-9f07-e62d1b46ad1a, identifier: FB83795
2026-03-30 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8434ef2-4001-547b-9f07-e62d1b46ad1a with identifier: FB83795
2026-03-30 11:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8434ef2-4001-547b-9f07-e62d1b46ad1a with identifier: FB83795
2026-03-30 11:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8434ef2-4001-547b-9f07-e62d1b46ad1a with identifier: FB83795 to the API
2026-03-30 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FB83795>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:02:24Z',
 'fuel_type': 'diesel',
 'id': 'd8434ef2-4001-547b-9f07-e62d1b46ad1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB83795',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 170821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7323d3733a0d983863857fd3a09905ad.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7dc819f4435e49a56738fd1550acec8f.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7313931e9d2c64ab7b62f63c385e9eb4.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_4c68f8ca73076bc7dd663ef65293c3fe.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_b5a2becc21e009cf27222f68f1ce58e9.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_8c08f265a47d69b79362ab4accbf09ed.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_ed0a373143d944b5383e98e29687126a.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_2d3b93c891cf54bc272c993ba533c08f.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_6ef5536378cae368f354c972c332abed.jpg',
                'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_6a527319e203fa0348b82e9e85e54cbe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7323d3733a0d983863857fd3a09905ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7dc819f4435e49a56738fd1550acec8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_7313931e9d2c64ab7b62f63c385e9eb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_4c68f8ca73076bc7dd663ef65293c3fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_b5a2becc21e009cf27222f68f1ce58e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_8c08f265a47d69b79362ab4accbf09ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_ed0a373143d944b5383e98e29687126a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_2d3b93c891cf54bc272c993ba533c08f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_6ef5536378cae368f354c972c332abed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8434ef2-4001-547b-9f07-e62d1b46ad1a/d8434ef2-4001-547b-9f07-e62d1b46ad1a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/56/3156bdc50154901288af10c8940fc50b/pa/FB83795_6a527319e203fa0348b82e9e85e54cbe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2018}
2026-03-30 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB83795%27 HTTP/1.1" 200 None
2026-03-30 11:37:12 [auto1.be] INFO: Saving data for FB83795: {'created_time': 1774870632.18078, 'last_price_update_time': 1774870632.18079, 'auction_closing_time': 1774969344.0}
2026-03-30 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FB83795') HTTP/1.1" 204 0
2026-03-30 11:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX83389> (referer: https://www.auto1.com/v1/car-details-view/HX83389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f3db22-ca9a-512f-908e-0490914c7f49 with identifier: HX83389
2026-03-30 11:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f3db22-ca9a-512f-908e-0490914c7f49 with scrape type 1
2026-03-30 11:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_13c007d06f75c23558709065b970b786.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_13c007d06f75c23558709065b970b786.jpg not downloaded yet
2026-03-30 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_06b801a20d5d98e4a9a12498fbb3e913.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_06b801a20d5d98e4a9a12498fbb3e913.jpg not downloaded yet
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_0180cbc21135da45ac52cc2e86c03637.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_0180cbc21135da45ac52cc2e86c03637.jpg not downloaded yet
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_006a043c642f476b5aabbbf739dc3412.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_006a043c642f476b5aabbbf739dc3412.jpg not downloaded yet
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_a5632eec696f83190f254690813d1854.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_a5632eec696f83190f254690813d1854.jpg not downloaded yet
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_08ecd864aa18ffa6c7ac93338b042551.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_08ecd864aa18ffa6c7ac93338b042551.jpg not downloaded yet
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_1f72931d0bfdfbec2191f15eed463e54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_1f72931d0bfdfbec2191f15eed463e54.jpg not downloaded yet
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_b18fd0517072c63429876777ba5b89fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_b18fd0517072c63429876777ba5b89fa.jpg not downloaded yet
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_13c007d06f75c23558709065b970b786.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_73e6181fe774e11bbb51fff454501fcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_73e6181fe774e11bbb51fff454501fcd.jpg not downloaded yet
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_ec18fee8a9647ee0c38f03c76877c493.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_ec18fee8a9647ee0c38f03c76877c493.jpg not downloaded yet
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc992c10>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_13c007d06f75c23558709065b970b786.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_13c007d06f75c23558709065b970b786.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_06b801a20d5d98e4a9a12498fbb3e913.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_0180cbc21135da45ac52cc2e86c03637.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_73e6181fe774e11bbb51fff454501fcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_ec18fee8a9647ee0c38f03c76877c493.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_1f72931d0bfdfbec2191f15eed463e54.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_b18fd0517072c63429876777ba5b89fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83bad0>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_06b801a20d5d98e4a9a12498fbb3e913.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_06b801a20d5d98e4a9a12498fbb3e913.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_08ecd864aa18ffa6c7ac93338b042551.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_a5632eec696f83190f254690813d1854.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc969310>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_0180cbc21135da45ac52cc2e86c03637.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_0180cbc21135da45ac52cc2e86c03637.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca46dd0>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_73e6181fe774e11bbb51fff454501fcd.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_73e6181fe774e11bbb51fff454501fcd.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc847710>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_ec18fee8a9647ee0c38f03c76877c493.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_ec18fee8a9647ee0c38f03c76877c493.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83ca90>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_1f72931d0bfdfbec2191f15eed463e54.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_1f72931d0bfdfbec2191f15eed463e54.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc887950>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_b18fd0517072c63429876777ba5b89fa.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_b18fd0517072c63429876777ba5b89fa.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_006a043c642f476b5aabbbf739dc3412.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc896050>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_08ecd864aa18ffa6c7ac93338b042551.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_08ecd864aa18ffa6c7ac93338b042551.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81f290>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_a5632eec696f83190f254690813d1854.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_a5632eec696f83190f254690813d1854.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b8210>
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F78%252F3978f9675932b977074e3b2c0b4e8882%252Fpa%252FHX83389_006a043c642f476b5aabbbf739dc3412.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_006a043c642f476b5aabbbf739dc3412.jpg saved to cache
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16f3db22-ca9a-512f-908e-0490914c7f49
2026-03-30 11:37:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16f3db22-ca9a-512f-908e-0490914c7f49, skipping ID generation
2026-03-30 11:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f3db22-ca9a-512f-908e-0490914c7f49 with scrape type 1
2026-03-30 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16f3db22-ca9a-512f-908e-0490914c7f49 sending to next pipeline
2026-03-30 11:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16f3db22-ca9a-512f-908e-0490914c7f49, identifier: HX83389
2026-03-30 11:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16f3db22-ca9a-512f-908e-0490914c7f49 with identifier: HX83389
2026-03-30 11:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16f3db22-ca9a-512f-908e-0490914c7f49 with identifier: HX83389
2026-03-30 11:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16f3db22-ca9a-512f-908e-0490914c7f49 with identifier: HX83389 to the API
2026-03-30 11:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_006a043c642f476b5aabbbf739dc3412.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:31:29Z',
 'fuel_type': 'petrol',
 'id': '16f3db22-ca9a-512f-908e-0490914c7f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX83389',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 164433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_13c007d06f75c23558709065b970b786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_06b801a20d5d98e4a9a12498fbb3e913.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_0180cbc21135da45ac52cc2e86c03637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_006a043c642f476b5aabbbf739dc3412.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_a5632eec696f83190f254690813d1854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_08ecd864aa18ffa6c7ac93338b042551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_1f72931d0bfdfbec2191f15eed463e54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_b18fd0517072c63429876777ba5b89fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_73e6181fe774e11bbb51fff454501fcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f3db22-ca9a-512f-908e-0490914c7f49/16f3db22-ca9a-512f-908e-0490914c7f49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/78/3978f9675932b977074e3b2c0b4e8882/pa/HX83389_ec18fee8a9647ee0c38f03c76877c493.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX83389%27 HTTP/1.1" 200 None
2026-03-30 11:37:30 [auto1.be] INFO: Saving data for HX83389: {'created_time': 1774870650.205018, 'last_price_update_time': 1774870650.20503, 'auction_closing_time': 1774971089.0}
2026-03-30 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX83389') HTTP/1.1" 204 0
2026-03-30 11:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC36206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:41 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1755 | hits on page: 40
2026-03-30 11:37:41 [auto1.be] INFO: Found listing with ID: ZF22511
2026-03-30 11:37:41 [auto1.be] INFO: Found listing with ID: ZH30880
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH30880%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.be] INFO: Scrape type for ZH30880: 1
2026-03-30 11:37:41 [auto1.be] INFO: Found listing with ID: XG33358
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG33358%27 HTTP/1.1" 200 None
2026-03-30 11:37:41 [auto1.be] INFO: Scrape type for XG33358: 1
2026-03-30 11:37:41 [auto1.be] INFO: Found listing with ID: UD24749
2026-03-30 11:37:41 [auto1.be] INFO: Found listing with ID: GY85550
2026-03-30 11:37:41 [auto1.be] INFO: Found listing with ID: HZ18358
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ18358%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for HZ18358: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: NY44737
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: NZ74080
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74080%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for NZ74080: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: FV32890
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV32890%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for FV32890: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: PJ15510
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ15510%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for PJ15510: 2
2026-03-30 11:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6447f5-42a8-5e84-9d28-56a8691df737 with identifier: PJ15510
2026-03-30 11:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6447f5-42a8-5e84-9d28-56a8691df737 with scrape type 2
2026-03-30 11:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a6447f5-42a8-5e84-9d28-56a8691df737 with scrape type 2
2026-03-30 11:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a6447f5-42a8-5e84-9d28-56a8691df737, identifier: PJ15510
2026-03-30 11:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a6447f5-42a8-5e84-9d28-56a8691df737 with identifier: PJ15510
2026-03-30 11:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a6447f5-42a8-5e84-9d28-56a8691df737 with identifier: PJ15510
2026-03-30 11:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a6447f5-42a8-5e84-9d28-56a8691df737 with identifier: PJ15510 to the API
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:26:38Z',
 'fuel_type': 'petrol',
 'id': '7a6447f5-42a8-5e84-9d28-56a8691df737',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ15510',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 172743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-26',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ15510%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Saving data for PJ15510: {'auction_closing_time': 1774970798.0, 'created_time': 1774298336.294136, 'last_price_update_time': 1774870662.502041}
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ15510') HTTP/1.1" 204 0
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: GP47231
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: RC25453
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25453%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for RC25453: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: BZ37751
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ37751%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for BZ37751: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: FN56971
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN56971%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for FN56971: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: CZ95998
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ95998%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for CZ95998: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: AX72969
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: GF16494
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: KP73013
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP73013%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for KP73013: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: MA85279
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA85279%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for MA85279: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: SN67129
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: HV12777
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: PG04506
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG04506%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for PG04506: 1
2026-03-30 11:37:42 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-30 11:37:42 [auto1.be] INFO: Scrape type for AX26323: 2
2026-03-30 11:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323
2026-03-30 11:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3664efe9-0502-52bc-b175-242d1874d595 with scrape type 2
2026-03-30 11:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3664efe9-0502-52bc-b175-242d1874d595 with scrape type 2
2026-03-30 11:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3664efe9-0502-52bc-b175-242d1874d595, identifier: AX26323
2026-03-30 11:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323
2026-03-30 11:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323
2026-03-30 11:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3664efe9-0502-52bc-b175-242d1874d595 with identifier: AX26323 to the API
2026-03-30 11:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:29:30Z',
 'fuel_type': 'diesel',
 'id': '3664efe9-0502-52bc-b175-242d1874d595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX26323',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 191767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-30 11:37:43 [auto1.be] INFO: Saving data for AX26323: {'auction_closing_time': 1774970970.0, 'created_time': 1773384248.836062, 'last_price_update_time': 1774870663.173344}
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX26323') HTTP/1.1" 204 0
2026-03-30 11:37:43 [auto1.be] INFO: Found listing with ID: DG79574
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG79574%27 HTTP/1.1" 200 None
2026-03-30 11:37:43 [auto1.be] INFO: Scrape type for DG79574: 2
2026-03-30 11:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c280c68b-8aa0-5690-b712-7bbc7dae862c with identifier: DG79574
2026-03-30 11:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c280c68b-8aa0-5690-b712-7bbc7dae862c with scrape type 2
2026-03-30 11:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c280c68b-8aa0-5690-b712-7bbc7dae862c with scrape type 2
2026-03-30 11:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c280c68b-8aa0-5690-b712-7bbc7dae862c, identifier: DG79574
2026-03-30 11:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c280c68b-8aa0-5690-b712-7bbc7dae862c with identifier: DG79574
2026-03-30 11:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c280c68b-8aa0-5690-b712-7bbc7dae862c with identifier: DG79574
2026-03-30 11:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c280c68b-8aa0-5690-b712-7bbc7dae862c with identifier: DG79574 to the API
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:24:26Z',
 'fuel_type': 'diesel',
 'id': 'c280c68b-8aa0-5690-b712-7bbc7dae862c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG79574',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 194668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2015}
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG79574%27 HTTP/1.1" 200 None
2026-03-30 11:37:43 [auto1.be] INFO: Saving data for DG79574: {'auction_closing_time': 1774970666.0, 'created_time': 1773693533.688797, 'last_price_update_time': 1774870663.76948}
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DG79574') HTTP/1.1" 204 0
2026-03-30 11:37:43 [auto1.be] INFO: Found listing with ID: AP83103
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP83103%27 HTTP/1.1" 200 None
2026-03-30 11:37:43 [auto1.be] INFO: Scrape type for AP83103: 1
2026-03-30 11:37:43 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-30 11:37:43 [auto1.be] INFO: Found listing with ID: EN33185
2026-03-30 11:37:43 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-30 11:37:43 [auto1.be] INFO: Found listing with ID: XT04818
2026-03-30 11:37:43 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-30 11:37:43 [auto1.be] INFO: Scrape type for TY97185: 2
2026-03-30 11:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185
2026-03-30 11:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b6ae16-5df6-5699-9b9f-54becf3d2522 with scrape type 2
2026-03-30 11:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51b6ae16-5df6-5699-9b9f-54becf3d2522 with scrape type 2
2026-03-30 11:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51b6ae16-5df6-5699-9b9f-54becf3d2522, identifier: TY97185
2026-03-30 11:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185
2026-03-30 11:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 11:37:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185
2026-03-30 11:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185 to the API
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:04:04Z',
 'fuel_type': 'petrol',
 'id': '51b6ae16-5df6-5699-9b9f-54becf3d2522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY97185',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 95663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-03',
 'seller_name': None,
 'title': 'Dacia Dokker 1.3 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2020}
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.be] INFO: Saving data for TY97185: {'auction_closing_time': 1774969444.0, 'created_time': 1774514151.498494, 'last_price_update_time': 1774870664.410285}
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY97185') HTTP/1.1" 204 0
2026-03-30 11:37:44 [auto1.be] INFO: Found listing with ID: LZ66906
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ66906%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.be] INFO: Scrape type for LZ66906: 1
2026-03-30 11:37:44 [auto1.be] INFO: Found listing with ID: SB08557
2026-03-30 11:37:44 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-30 11:37:44 [auto1.be] INFO: Found listing with ID: VM73638
2026-03-30 11:37:44 [auto1.be] INFO: Found listing with ID: NN23833
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN23833%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.be] INFO: Scrape type for NN23833: 1
2026-03-30 11:37:44 [auto1.be] INFO: Found listing with ID: LL36381
2026-03-30 11:37:44 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.be] INFO: Scrape type for GC32489: 2
2026-03-30 11:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489
2026-03-30 11:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d979e361-81ca-5419-acb4-c9d3a10dd488 with scrape type 2
2026-03-30 11:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d979e361-81ca-5419-acb4-c9d3a10dd488 with scrape type 2
2026-03-30 11:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d979e361-81ca-5419-acb4-c9d3a10dd488, identifier: GC32489
2026-03-30 11:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489
2026-03-30 11:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489
2026-03-30 11:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d979e361-81ca-5419-acb4-c9d3a10dd488 with identifier: GC32489 to the API
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:13:05Z',
 'fuel_type': 'diesel',
 'id': 'd979e361-81ca-5419-acb4-c9d3a10dd488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC32489',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 251610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-30 11:37:44 [auto1.be] INFO: Saving data for GC32489: {'auction_closing_time': 1774969985.0, 'created_time': 1773134802.692111, 'last_price_update_time': 1774870664.908588}
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC32489') HTTP/1.1" 204 0
2026-03-30 11:37:45 [auto1.be] INFO: Found listing with ID: ML14183
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML14183%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.be] INFO: Scrape type for ML14183: 1
2026-03-30 11:37:45 [auto1.be] INFO: Found listing with ID: TY10395
2026-03-30 11:37:45 [auto1.be] INFO: Found listing with ID: DR07061
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR07061%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.be] INFO: Scrape type for DR07061: 2
2026-03-30 11:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f with identifier: DR07061
2026-03-30 11:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f with scrape type 2
2026-03-30 11:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f with scrape type 2
2026-03-30 11:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f, identifier: DR07061
2026-03-30 11:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f with identifier: DR07061
2026-03-30 11:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f with identifier: DR07061
2026-03-30 11:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f with identifier: DR07061 to the API
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:48:44Z',
 'fuel_type': 'diesel',
 'id': '641c2e6d-19ae-55ae-9f0d-4ac0a6c96e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR07061',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 90147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR07061%27 HTTP/1.1" 200 None
2026-03-30 11:37:45 [auto1.be] INFO: Saving data for DR07061: {'auction_closing_time': 1774972124.0, 'created_time': 1774125501.459376, 'last_price_update_time': 1774870665.468531}
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DR07061') HTTP/1.1" 204 0
2026-03-30 11:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP60606> (referer: https://www.auto1.com/v1/car-details-view/DP60606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3 with identifier: DP60606
2026-03-30 11:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3 with scrape type 1
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_5108229478deb0ad4cbf192c90306c20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5108229478deb0ad4cbf192c90306c20.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_492f25ff529dbadb8035a2be1713e13a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_492f25ff529dbadb8035a2be1713e13a.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_ec65d679b4212eb90c5e4fba9c331d84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_ec65d679b4212eb90c5e4fba9c331d84.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_06b13dba681649389a2924ea73734a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_06b13dba681649389a2924ea73734a95.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_0763ff650ff0ff59345e16a998ca2b8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0763ff650ff0ff59345e16a998ca2b8f.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_5b82e01441971f35a21a775d5bf8f3d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5b82e01441971f35a21a775d5bf8f3d4.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_2bfba1bcc6699320674863af0d7569d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_2bfba1bcc6699320674863af0d7569d4.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_c1f95c80f760258de6deff55478d57c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_c1f95c80f760258de6deff55478d57c0.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_0b14ad7f91dcc8687c2fc310e7aa386f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0b14ad7f91dcc8687c2fc310e7aa386f.jpg not downloaded yet
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_089eb9b4fa9b6576d935cd08c42b646b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_089eb9b4fa9b6576d935cd08c42b646b.jpg not downloaded yet
2026-03-30 11:38:06 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 5 pages/min), scraped 15 items (at 8 items/min)
2026-03-30 11:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 11:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA94811> (referer: https://www.auto1.com/v1/car-details-view/JA94811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 115e8894-b5e1-5054-861c-f100482eaa01 with identifier: JA94811
2026-03-30 11:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115e8894-b5e1-5054-861c-f100482eaa01 with scrape type 1
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 115e8894-b5e1-5054-861c-f100482eaa01
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_9993a0f8b07357c5e2582ce4e178bac8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_9993a0f8b07357c5e2582ce4e178bac8.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_931f5c9983e4e86377f9e1b2d830f85a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_931f5c9983e4e86377f9e1b2d830f85a.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_b627ad56b42b77aa7bbf82f18f185177.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_b627ad56b42b77aa7bbf82f18f185177.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_e1f47d628a5dc112e48eec9373fd1299.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_e1f47d628a5dc112e48eec9373fd1299.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_0b127c59bbc9f6ca69b3d47a9d408b76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_0b127c59bbc9f6ca69b3d47a9d408b76.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_45f23115355aa1ed39efa20472f1a888.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_45f23115355aa1ed39efa20472f1a888.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_490942c0b0530f2a6a4796bbb76e876e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_490942c0b0530f2a6a4796bbb76e876e.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_815eb73c41d6bf1cbd9e64884b049eac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_815eb73c41d6bf1cbd9e64884b049eac.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_a7d279341f2de733c64ad72f5bb0cf59.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_a7d279341f2de733c64ad72f5bb0cf59.jpg already downloaded
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fa9%252Fada9ad611bc92ccf4b6a9e77ae572298%252Fpa%252FJA94811_b0d3c452c7e5f927dd04c16b19680752.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_b0d3c452c7e5f927dd04c16b19680752.jpg already downloaded
2026-03-30 11:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 115e8894-b5e1-5054-861c-f100482eaa01, identifier: JA94811
2026-03-30 11:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 115e8894-b5e1-5054-861c-f100482eaa01 with identifier: JA94811
2026-03-30 11:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 115e8894-b5e1-5054-861c-f100482eaa01 with identifier: JA94811
2026-03-30 11:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 115e8894-b5e1-5054-861c-f100482eaa01 with identifier: JA94811 to the API
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JA94811>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:17Z',
 'fuel_type': 'diesel',
 'id': '115e8894-b5e1-5054-861c-f100482eaa01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA94811',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 88638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_9993a0f8b07357c5e2582ce4e178bac8.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_931f5c9983e4e86377f9e1b2d830f85a.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_b627ad56b42b77aa7bbf82f18f185177.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_e1f47d628a5dc112e48eec9373fd1299.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_0b127c59bbc9f6ca69b3d47a9d408b76.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_45f23115355aa1ed39efa20472f1a888.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_490942c0b0530f2a6a4796bbb76e876e.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_815eb73c41d6bf1cbd9e64884b049eac.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_a7d279341f2de733c64ad72f5bb0cf59.jpg',
                'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_b0d3c452c7e5f927dd04c16b19680752.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_9993a0f8b07357c5e2582ce4e178bac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_931f5c9983e4e86377f9e1b2d830f85a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_b627ad56b42b77aa7bbf82f18f185177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_e1f47d628a5dc112e48eec9373fd1299.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_0b127c59bbc9f6ca69b3d47a9d408b76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_45f23115355aa1ed39efa20472f1a888.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_490942c0b0530f2a6a4796bbb76e876e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_815eb73c41d6bf1cbd9e64884b049eac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_a7d279341f2de733c64ad72f5bb0cf59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115e8894-b5e1-5054-861c-f100482eaa01/115e8894-b5e1-5054-861c-f100482eaa01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/a9/ada9ad611bc92ccf4b6a9e77ae572298/pa/JA94811_b0d3c452c7e5f927dd04c16b19680752.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA94811%27 HTTP/1.1" 200 None
2026-03-30 11:38:24 [auto1.be] INFO: Saving data for JA94811: {'created_time': 1774870704.948994, 'last_price_update_time': 1774870704.949008, 'auction_closing_time': 1774972577.0}
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JA94811') HTTP/1.1" 204 0
2026-03-30 11:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_089eb9b4fa9b6576d935cd08c42b646b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0b14ad7f91dcc8687c2fc310e7aa386f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc951850>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_089eb9b4fa9b6576d935cd08c42b646b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_089eb9b4fa9b6576d935cd08c42b646b.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_c1f95c80f760258de6deff55478d57c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc887a50>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_0b14ad7f91dcc8687c2fc310e7aa386f.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0b14ad7f91dcc8687c2fc310e7aa386f.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_2bfba1bcc6699320674863af0d7569d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca41d10>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_c1f95c80f760258de6deff55478d57c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_c1f95c80f760258de6deff55478d57c0.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5b82e01441971f35a21a775d5bf8f3d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9022d0>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_2bfba1bcc6699320674863af0d7569d4.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_2bfba1bcc6699320674863af0d7569d4.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0763ff650ff0ff59345e16a998ca2b8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_06b13dba681649389a2924ea73734a95.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca46f50>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_5b82e01441971f35a21a775d5bf8f3d4.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5b82e01441971f35a21a775d5bf8f3d4.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_ec65d679b4212eb90c5e4fba9c331d84.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca44890>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_0763ff650ff0ff59345e16a998ca2b8f.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0763ff650ff0ff59345e16a998ca2b8f.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_492f25ff529dbadb8035a2be1713e13a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc881690>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_06b13dba681649389a2924ea73734a95.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_06b13dba681649389a2924ea73734a95.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc818750>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_ec65d679b4212eb90c5e4fba9c331d84.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_ec65d679b4212eb90c5e4fba9c331d84.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5108229478deb0ad4cbf192c90306c20.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc894d10>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_492f25ff529dbadb8035a2be1713e13a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_492f25ff529dbadb8035a2be1713e13a.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc94be50>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F21%252F982193e971c47301cc486380503e03dd%252Fpa%252FDP60606_5108229478deb0ad4cbf192c90306c20.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5108229478deb0ad4cbf192c90306c20.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3
2026-03-30 11:38:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3, skipping ID generation
2026-03-30 11:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3 with scrape type 1
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3 sending to next pipeline
2026-03-30 11:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3, identifier: DP60606
2026-03-30 11:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3 with identifier: DP60606
2026-03-30 11:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3 with identifier: DP60606
2026-03-30 11:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3 with identifier: DP60606 to the API
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5108229478deb0ad4cbf192c90306c20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:43:59Z',
 'fuel_type': 'diesel',
 'id': 'ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP60606',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'BMW',
 'model': '3er',
 'odometer': 213772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5108229478deb0ad4cbf192c90306c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_492f25ff529dbadb8035a2be1713e13a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_ec65d679b4212eb90c5e4fba9c331d84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_06b13dba681649389a2924ea73734a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0763ff650ff0ff59345e16a998ca2b8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_5b82e01441971f35a21a775d5bf8f3d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_2bfba1bcc6699320674863af0d7569d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_c1f95c80f760258de6deff55478d57c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_0b14ad7f91dcc8687c2fc310e7aa386f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3/ceec0a3e-72a4-5ef7-80ae-f9b56cbfd1f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/21/982193e971c47301cc486380503e03dd/pa/DP60606_089eb9b4fa9b6576d935cd08c42b646b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Edition',
 'year': 2012}
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP60606%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.be] INFO: Saving data for DP60606: {'created_time': 1774870706.175608, 'last_price_update_time': 1774870706.175619, 'auction_closing_time': 1774971839.0}
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP60606') HTTP/1.1" 204 0
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL11462> (referer: https://www.auto1.com/v1/car-details-view/TL11462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70665f76-72d9-58f8-b135-d0bd3f9a8d18 with identifier: TL11462
2026-03-30 11:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70665f76-72d9-58f8-b135-d0bd3f9a8d18 with scrape type 1
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70665f76-72d9-58f8-b135-d0bd3f9a8d18
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_9585b40b4e69e615651f29719ce73b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_9585b40b4e69e615651f29719ce73b99.jpg not downloaded yet
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_b23259682060c94c2cd294c4bfcb1198.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_b23259682060c94c2cd294c4bfcb1198.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_6b6b211cea0eff5a5b0ed73c2ce683cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_6b6b211cea0eff5a5b0ed73c2ce683cc.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_be6637691464f7e08725af73700776fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_be6637691464f7e08725af73700776fb.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_66f658d82291566f4b68c00b1503b505.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_66f658d82291566f4b68c00b1503b505.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_ed1a3977ef0b26c1066833c17736b5a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_ed1a3977ef0b26c1066833c17736b5a7.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_8731071532d67ee09fdafd08e9bee66d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_8731071532d67ee09fdafd08e9bee66d.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_e656efee4d1e229e6b3498569cb15194.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_e656efee4d1e229e6b3498569cb15194.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_0a36e75b1360c8acee5de8a4f42c36fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_0a36e75b1360c8acee5de8a4f42c36fb.jpg already downloaded
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_5b297aa68c5fbbec53fdbe87ff96873b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_5b297aa68c5fbbec53fdbe87ff96873b.jpg already downloaded
2026-03-30 11:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME23614> (referer: https://www.auto1.com/v1/car-details-view/ME23614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_9585b40b4e69e615651f29719ce73b99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a161d5c5-7777-5eac-b907-1c40c0ef306a with identifier: ME23614
2026-03-30 11:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a161d5c5-7777-5eac-b907-1c40c0ef306a with scrape type 1
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_de24f6aa04953982d3c38f5b8f0d76b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_de24f6aa04953982d3c38f5b8f0d76b4.jpg not downloaded yet
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_00efe37c12ecc695bbb285e03a3ff146.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_00efe37c12ecc695bbb285e03a3ff146.jpg not downloaded yet
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_ae85fa20ec3f522d27b87cc998eb510e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_ae85fa20ec3f522d27b87cc998eb510e.jpg not downloaded yet
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_2a3b86dd89e23ce25e5639f11d534608.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_2a3b86dd89e23ce25e5639f11d534608.jpg not downloaded yet
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_72c53e9b67a963146cdc8c133e93c4da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_72c53e9b67a963146cdc8c133e93c4da.jpg not downloaded yet
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8e8990>
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F76%252F387614260c3764f9479a0bba4d53e084%252Fpa%252FTL11462_9585b40b4e69e615651f29719ce73b99.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_9585b40b4e69e615651f29719ce73b99.jpg saved to cache
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70665f76-72d9-58f8-b135-d0bd3f9a8d18
2026-03-30 11:38:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70665f76-72d9-58f8-b135-d0bd3f9a8d18, skipping ID generation
2026-03-30 11:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70665f76-72d9-58f8-b135-d0bd3f9a8d18 with scrape type 1
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70665f76-72d9-58f8-b135-d0bd3f9a8d18 sending to next pipeline
2026-03-30 11:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70665f76-72d9-58f8-b135-d0bd3f9a8d18, identifier: TL11462
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_4072a965f5747178c4f0accf68737f76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_4072a965f5747178c4f0accf68737f76.jpg not downloaded yet
2026-03-30 11:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70665f76-72d9-58f8-b135-d0bd3f9a8d18 with identifier: TL11462
2026-03-30 11:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70665f76-72d9-58f8-b135-d0bd3f9a8d18 with identifier: TL11462
2026-03-30 11:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70665f76-72d9-58f8-b135-d0bd3f9a8d18 with identifier: TL11462 to the API
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_9585b40b4e69e615651f29719ce73b99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': 'Taxi',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:46:32Z',
 'fuel_type': 'diesel',
 'id': '70665f76-72d9-58f8-b135-d0bd3f9a8d18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL11462',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 222992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_9585b40b4e69e615651f29719ce73b99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2889339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_b23259682060c94c2cd294c4bfcb1198.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793218,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_6b6b211cea0eff5a5b0ed73c2ce683cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_be6637691464f7e08725af73700776fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671175,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_66f658d82291566f4b68c00b1503b505.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2892663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_ed1a3977ef0b26c1066833c17736b5a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_8731071532d67ee09fdafd08e9bee66d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_e656efee4d1e229e6b3498569cb15194.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_0a36e75b1360c8acee5de8a4f42c36fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70665f76-72d9-58f8-b135-d0bd3f9a8d18/70665f76-72d9-58f8-b135-d0bd3f9a8d18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/76/387614260c3764f9479a0bba4d53e084/pa/TL11462_5b297aa68c5fbbec53fdbe87ff96873b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL11462%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Saving data for TL11462: {'created_time': 1774870708.616735, 'last_price_update_time': 1774870708.616746, 'auction_closing_time': 1774971992.0}
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL11462') HTTP/1.1" 204 0
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_0d9ab4a8343dd0256e3a294f850921a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_0d9ab4a8343dd0256e3a294f850921a9.jpg not downloaded yet
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_65dc6d68ec2e7650db61743d149cc17a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_65dc6d68ec2e7650db61743d149cc17a.jpg not downloaded yet
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_5d991203d0c1c06d821993e5206b27a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_5d991203d0c1c06d821993e5206b27a4.jpg not downloaded yet
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_04973fe88b1f5e502ea8e82302b1fe98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_04973fe88b1f5e502ea8e82302b1fe98.jpg not downloaded yet
2026-03-30 11:38:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.335(s), this was the 1st time calling it.
2026-03-30 11:38:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.602892167964729 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.412(s), this was the 1st time calling it.
2026-03-30 11:38:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.704750568501517 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.433(s), this was the 1st time calling it.
2026-03-30 11:38:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.897529579759311 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC36206> (referer: https://www.auto1.com/v1/car-details-view/NC36206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_04973fe88b1f5e502ea8e82302b1fe98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe908117-33b5-530f-97fe-bcc6906fc61c with identifier: NC36206
2026-03-30 11:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe908117-33b5-530f-97fe-bcc6906fc61c with scrape type 1
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_58db3e6a8646e60603cd738e9597cc51.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_58db3e6a8646e60603cd738e9597cc51.jpg not downloaded yet
2026-03-30 11:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_5d991203d0c1c06d821993e5206b27a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_25e51cd9e91b2542848dc72495cf62ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_25e51cd9e91b2542848dc72495cf62ae.jpg not downloaded yet
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_d3cab274982565fe01b26407841524f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_d3cab274982565fe01b26407841524f5.jpg not downloaded yet
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc880b90>
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_04973fe88b1f5e502ea8e82302b1fe98.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_04973fe88b1f5e502ea8e82302b1fe98.jpg saved to cache
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_b10a1a09b5a34ce75610a1e078a5c610.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_b10a1a09b5a34ce75610a1e078a5c610.jpg not downloaded yet
2026-03-30 11:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_58db3e6a8646e60603cd738e9597cc51.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_01ce051cb098cff1beb17b3626a0dc50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_01ce051cb098cff1beb17b3626a0dc50.jpg not downloaded yet
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc838990>
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_5d991203d0c1c06d821993e5206b27a4.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_5d991203d0c1c06d821993e5206b27a4.jpg saved to cache
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_2c264dbb57a6bc648d755a309ffe9992.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_2c264dbb57a6bc648d755a309ffe9992.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_12791d475b77aa74dacc2e47463a1a1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_12791d475b77aa74dacc2e47463a1a1a.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_a36e2293743b3b998175211005dd45d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a36e2293743b3b998175211005dd45d6.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_38cb0a6e1bddc18aa40b0f0cdaac4b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_38cb0a6e1bddc18aa40b0f0cdaac4b0a.jpg not downloaded yet
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc952b90>
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_58db3e6a8646e60603cd738e9597cc51.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_58db3e6a8646e60603cd738e9597cc51.jpg saved to cache
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_a0e61622aae443cbd245a72777bedabe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a0e61622aae443cbd245a72777bedabe.jpg not downloaded yet
2026-03-30 11:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_b10a1a09b5a34ce75610a1e078a5c610.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcab07d0>
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_b10a1a09b5a34ce75610a1e078a5c610.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_b10a1a09b5a34ce75610a1e078a5c610.jpg saved to cache
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a0e61622aae443cbd245a72777bedabe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8eb890>
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_a0e61622aae443cbd245a72777bedabe.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a0e61622aae443cbd245a72777bedabe.jpg saved to cache
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_38cb0a6e1bddc18aa40b0f0cdaac4b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7bb2d0>
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_38cb0a6e1bddc18aa40b0f0cdaac4b0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_38cb0a6e1bddc18aa40b0f0cdaac4b0a.jpg saved to cache
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a36e2293743b3b998175211005dd45d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_12791d475b77aa74dacc2e47463a1a1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca52710>
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_a36e2293743b3b998175211005dd45d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a36e2293743b3b998175211005dd45d6.jpg saved to cache
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca51150>
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_12791d475b77aa74dacc2e47463a1a1a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_12791d475b77aa74dacc2e47463a1a1a.jpg saved to cache
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_2c264dbb57a6bc648d755a309ffe9992.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcab1a90>
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_2c264dbb57a6bc648d755a309ffe9992.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_2c264dbb57a6bc648d755a309ffe9992.jpg saved to cache
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_01ce051cb098cff1beb17b3626a0dc50.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_d3cab274982565fe01b26407841524f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8655d0>
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_01ce051cb098cff1beb17b3626a0dc50.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_01ce051cb098cff1beb17b3626a0dc50.jpg saved to cache
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_25e51cd9e91b2542848dc72495cf62ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9511d0>
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_d3cab274982565fe01b26407841524f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_d3cab274982565fe01b26407841524f5.jpg saved to cache
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_65dc6d68ec2e7650db61743d149cc17a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_0d9ab4a8343dd0256e3a294f850921a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc819610>
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F3c%252F303c0c286530d38609095a5c15ee42e3%252Fpa%252FNC36206_25e51cd9e91b2542848dc72495cf62ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_25e51cd9e91b2542848dc72495cf62ae.jpg saved to cache
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe908117-33b5-530f-97fe-bcc6906fc61c
2026-03-30 11:38:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe908117-33b5-530f-97fe-bcc6906fc61c, skipping ID generation
2026-03-30 11:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe908117-33b5-530f-97fe-bcc6906fc61c with scrape type 1
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe908117-33b5-530f-97fe-bcc6906fc61c sending to next pipeline
2026-03-30 11:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fe908117-33b5-530f-97fe-bcc6906fc61c, identifier: NC36206
2026-03-30 11:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fe908117-33b5-530f-97fe-bcc6906fc61c with identifier: NC36206
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fe908117-33b5-530f-97fe-bcc6906fc61c with identifier: NC36206
2026-03-30 11:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fe908117-33b5-530f-97fe-bcc6906fc61c with identifier: NC36206 to the API
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_25e51cd9e91b2542848dc72495cf62ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:22:28Z',
 'fuel_type': 'diesel',
 'id': 'fe908117-33b5-530f-97fe-bcc6906fc61c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC36206',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 55303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_58db3e6a8646e60603cd738e9597cc51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_25e51cd9e91b2542848dc72495cf62ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_d3cab274982565fe01b26407841524f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_b10a1a09b5a34ce75610a1e078a5c610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_01ce051cb098cff1beb17b3626a0dc50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_2c264dbb57a6bc648d755a309ffe9992.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_12791d475b77aa74dacc2e47463a1a1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a36e2293743b3b998175211005dd45d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_38cb0a6e1bddc18aa40b0f0cdaac4b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe908117-33b5-530f-97fe-bcc6906fc61c/fe908117-33b5-530f-97fe-bcc6906fc61c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/3c/303c0c286530d38609095a5c15ee42e3/pa/NC36206_a0e61622aae443cbd245a72777bedabe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC36206%27 HTTP/1.1" 200 None
2026-03-30 11:38:41 [auto1.be] INFO: Saving data for NC36206: {'created_time': 1774870721.958073, 'last_price_update_time': 1774870721.958083, 'auction_closing_time': 1774970548.0}
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC36206') HTTP/1.1" 204 0
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_4072a965f5747178c4f0accf68737f76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc894d90>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_65dc6d68ec2e7650db61743d149cc17a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_65dc6d68ec2e7650db61743d149cc17a.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc819690>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_0d9ab4a8343dd0256e3a294f850921a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_0d9ab4a8343dd0256e3a294f850921a9.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de824810>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_4072a965f5747178c4f0accf68737f76.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_4072a965f5747178c4f0accf68737f76.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_72c53e9b67a963146cdc8c133e93c4da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_2a3b86dd89e23ce25e5639f11d534608.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_ae85fa20ec3f522d27b87cc998eb510e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8ea1d0>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_72c53e9b67a963146cdc8c133e93c4da.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_72c53e9b67a963146cdc8c133e93c4da.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_00efe37c12ecc695bbb285e03a3ff146.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc953d50>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_2a3b86dd89e23ce25e5639f11d534608.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_2a3b86dd89e23ce25e5639f11d534608.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca578d0>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_ae85fa20ec3f522d27b87cc998eb510e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_ae85fa20ec3f522d27b87cc998eb510e.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_de24f6aa04953982d3c38f5b8f0d76b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8397d0>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_00efe37c12ecc695bbb285e03a3ff146.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_00efe37c12ecc695bbb285e03a3ff146.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca3edd0>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F3d%252Fd93d2e526baefd90ab59894224836c83%252Fpa%252FME23614_de24f6aa04953982d3c38f5b8f0d76b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_de24f6aa04953982d3c38f5b8f0d76b4.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a161d5c5-7777-5eac-b907-1c40c0ef306a
2026-03-30 11:38:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a161d5c5-7777-5eac-b907-1c40c0ef306a, skipping ID generation
2026-03-30 11:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a161d5c5-7777-5eac-b907-1c40c0ef306a with scrape type 1
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a161d5c5-7777-5eac-b907-1c40c0ef306a sending to next pipeline
2026-03-30 11:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a161d5c5-7777-5eac-b907-1c40c0ef306a, identifier: ME23614
2026-03-30 11:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a161d5c5-7777-5eac-b907-1c40c0ef306a with identifier: ME23614
2026-03-30 11:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a161d5c5-7777-5eac-b907-1c40c0ef306a with identifier: ME23614
2026-03-30 11:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a161d5c5-7777-5eac-b907-1c40c0ef306a with identifier: ME23614 to the API
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_de24f6aa04953982d3c38f5b8f0d76b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:04:43Z',
 'fuel_type': 'petrol',
 'id': 'a161d5c5-7777-5eac-b907-1c40c0ef306a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME23614',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 148289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_de24f6aa04953982d3c38f5b8f0d76b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_00efe37c12ecc695bbb285e03a3ff146.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_ae85fa20ec3f522d27b87cc998eb510e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_2a3b86dd89e23ce25e5639f11d534608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_72c53e9b67a963146cdc8c133e93c4da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_4072a965f5747178c4f0accf68737f76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_0d9ab4a8343dd0256e3a294f850921a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_65dc6d68ec2e7650db61743d149cc17a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_5d991203d0c1c06d821993e5206b27a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a161d5c5-7777-5eac-b907-1c40c0ef306a/a161d5c5-7777-5eac-b907-1c40c0ef306a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/3d/d93d2e526baefd90ab59894224836c83/pa/ME23614_04973fe88b1f5e502ea8e82302b1fe98.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME23614%27 HTTP/1.1" 200 None
2026-03-30 11:38:42 [auto1.be] INFO: Saving data for ME23614: {'created_time': 1774870722.961763, 'last_price_update_time': 1774870722.961775, 'auction_closing_time': 1774969483.0}
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME23614') HTTP/1.1" 204 0
2026-03-30 11:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:45 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1756 | hits on page: 40
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: DR07061
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR07061%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.be] INFO: Scrape type for DR07061: 0
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: VW96502
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: DF90944
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF90944%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.be] INFO: Scrape type for DF90944: 1
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: VN70720
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VN70720%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.be] INFO: Scrape type for VN70720: 2
2026-03-30 11:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47eaea05-784a-550b-87ad-23e0e5b49e6b with identifier: VN70720
2026-03-30 11:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47eaea05-784a-550b-87ad-23e0e5b49e6b with scrape type 2
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47eaea05-784a-550b-87ad-23e0e5b49e6b with scrape type 2
2026-03-30 11:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 47eaea05-784a-550b-87ad-23e0e5b49e6b, identifier: VN70720
2026-03-30 11:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 47eaea05-784a-550b-87ad-23e0e5b49e6b with identifier: VN70720
2026-03-30 11:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 47eaea05-784a-550b-87ad-23e0e5b49e6b with identifier: VN70720
2026-03-30 11:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 47eaea05-784a-550b-87ad-23e0e5b49e6b with identifier: VN70720 to the API
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:22:06Z',
 'fuel_type': 'petrol',
 'id': '47eaea05-784a-550b-87ad-23e0e5b49e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN70720',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 98629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Porsche Macan Basis',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VN70720%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.be] INFO: Saving data for VN70720: {'auction_closing_time': 1774970526.0, 'created_time': 1773661869.115896, 'last_price_update_time': 1774870725.58888}
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VN70720') HTTP/1.1" 204 0
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: XD51525
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: GW35793
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW35793%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.be] INFO: Scrape type for GW35793: 1
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: GE39659
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: HU41998
2026-03-30 11:38:45 [auto1.be] INFO: Found listing with ID: EX80528
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX80528%27 HTTP/1.1" 200 None
2026-03-30 11:38:45 [auto1.be] INFO: Scrape type for EX80528: 2
2026-03-30 11:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 828940a4-6f9d-59d1-af97-11310b9e884c with identifier: EX80528
2026-03-30 11:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 828940a4-6f9d-59d1-af97-11310b9e884c with scrape type 2
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 828940a4-6f9d-59d1-af97-11310b9e884c with scrape type 2
2026-03-30 11:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 828940a4-6f9d-59d1-af97-11310b9e884c, identifier: EX80528
2026-03-30 11:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 828940a4-6f9d-59d1-af97-11310b9e884c with identifier: EX80528
2026-03-30 11:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 828940a4-6f9d-59d1-af97-11310b9e884c with identifier: EX80528
2026-03-30 11:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 828940a4-6f9d-59d1-af97-11310b9e884c with identifier: EX80528 to the API
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-31T15:12:41Z',
 'fuel_type': 'petrol',
 'id': '828940a4-6f9d-59d1-af97-11310b9e884c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX80528',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 120488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-19',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX80528%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.be] INFO: Saving data for EX80528: {'auction_closing_time': 1774969961.0, 'created_time': 1773693603.257683, 'last_price_update_time': 1774870726.758777}
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX80528') HTTP/1.1" 204 0
2026-03-30 11:38:46 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.be] INFO: Scrape type for AN69845: 2
2026-03-30 11:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845
2026-03-30 11:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bac3a6f-da33-5aca-9a98-10d4db848e4c with scrape type 2
2026-03-30 11:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bac3a6f-da33-5aca-9a98-10d4db848e4c with scrape type 2
2026-03-30 11:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bac3a6f-da33-5aca-9a98-10d4db848e4c, identifier: AN69845
2026-03-30 11:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845
2026-03-30 11:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845
2026-03-30 11:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845 to the API
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:01:03Z',
 'fuel_type': 'diesel',
 'id': '2bac3a6f-da33-5aca-9a98-10d4db848e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN69845',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 170119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-22',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Saving data for AN69845: {'auction_closing_time': 1774969263.0, 'created_time': 1774514136.819731, 'last_price_update_time': 1774870727.364138}
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AN69845') HTTP/1.1" 204 0
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ63633%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for EJ63633: 0
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: UD84519
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD84519%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for UD84519: 1
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: YS23532
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: XP52428
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP52428%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for XP52428: 1
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: DC49978
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: SM03670
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: KJ54388
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KJ54388%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for KJ54388: 1
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: CR86629
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR86629%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for CR86629: 1
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: MZ25594
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ25594%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for MZ25594: 2
2026-03-30 11:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ee3f6b5-ae83-5682-a21a-5bc571d7ca53 with identifier: MZ25594
2026-03-30 11:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ee3f6b5-ae83-5682-a21a-5bc571d7ca53 with scrape type 2
2026-03-30 11:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ee3f6b5-ae83-5682-a21a-5bc571d7ca53 with scrape type 2
2026-03-30 11:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ee3f6b5-ae83-5682-a21a-5bc571d7ca53, identifier: MZ25594
2026-03-30 11:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ee3f6b5-ae83-5682-a21a-5bc571d7ca53 with identifier: MZ25594
2026-03-30 11:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ee3f6b5-ae83-5682-a21a-5bc571d7ca53 with identifier: MZ25594
2026-03-30 11:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ee3f6b5-ae83-5682-a21a-5bc571d7ca53 with identifier: MZ25594 to the API
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:58:51Z',
 'fuel_type': 'petrol',
 'id': '6ee3f6b5-ae83-5682-a21a-5bc571d7ca53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ25594',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 83099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ25594%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Saving data for MZ25594: {'auction_closing_time': 1774972731.0, 'created_time': 1773693775.352685, 'last_price_update_time': 1774870727.889865}
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ25594') HTTP/1.1" 204 0
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: AK26681
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK26681%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for AK26681: 1
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: YV94819
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: EX41608
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: AN71185
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: PK57553
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: TW44270
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: HH57000
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH57000%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for HH57000: 1
2026-03-30 11:38:47 [auto1.be] INFO: Found listing with ID: FG64807
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG64807%27 HTTP/1.1" 200 None
2026-03-30 11:38:47 [auto1.be] INFO: Scrape type for FG64807: 2
2026-03-30 11:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db60e2fc-6ca1-5241-94c3-6781726977c0 with identifier: FG64807
2026-03-30 11:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db60e2fc-6ca1-5241-94c3-6781726977c0 with scrape type 2
2026-03-30 11:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db60e2fc-6ca1-5241-94c3-6781726977c0 with scrape type 2
2026-03-30 11:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db60e2fc-6ca1-5241-94c3-6781726977c0, identifier: FG64807
2026-03-30 11:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db60e2fc-6ca1-5241-94c3-6781726977c0 with identifier: FG64807
2026-03-30 11:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db60e2fc-6ca1-5241-94c3-6781726977c0 with identifier: FG64807
2026-03-30 11:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db60e2fc-6ca1-5241-94c3-6781726977c0 with identifier: FG64807 to the API
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:30:20Z',
 'fuel_type': 'diesel',
 'id': 'db60e2fc-6ca1-5241-94c3-6781726977c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG64807',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 186914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-05',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG64807%27 HTTP/1.1" 200 None
2026-03-30 11:38:48 [auto1.be] INFO: Saving data for FG64807: {'auction_closing_time': 1774971020.0, 'created_time': 1773137606.394608, 'last_price_update_time': 1774870728.412064}
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG64807') HTTP/1.1" 204 0
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-30 11:38:48 [auto1.be] INFO: Scrape type for GF59002: 2
2026-03-30 11:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002
2026-03-30 11:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b307dbf-534f-5af8-9ac2-99336b8f5895 with scrape type 2
2026-03-30 11:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b307dbf-534f-5af8-9ac2-99336b8f5895 with scrape type 2
2026-03-30 11:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b307dbf-534f-5af8-9ac2-99336b8f5895, identifier: GF59002
2026-03-30 11:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002
2026-03-30 11:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002
2026-03-30 11:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002 to the API
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:01:41Z',
 'fuel_type': 'petrol',
 'id': '6b307dbf-534f-5af8-9ac2-99336b8f5895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF59002',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 61973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-30 11:38:48 [auto1.be] INFO: Saving data for GF59002: {'auction_closing_time': 1774969301.0, 'created_time': 1773822927.639751, 'last_price_update_time': 1774870728.956141}
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF59002') HTTP/1.1" 204 0
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: KU43333
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: JL68668
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL68668%27 HTTP/1.1" 200 None
2026-03-30 11:38:48 [auto1.be] INFO: Scrape type for JL68668: 1
2026-03-30 11:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP20527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: KV35252
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: XL30986
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: CB18656
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: XT98114
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: HT72624
2026-03-30 11:38:48 [auto1.be] INFO: Found listing with ID: PV43635
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV43635%27 HTTP/1.1" 200 None
2026-03-30 11:38:49 [auto1.be] INFO: Scrape type for PV43635: 2
2026-03-30 11:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f416dc-ce0a-5399-851e-7ae69a84a2fc with identifier: PV43635
2026-03-30 11:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f416dc-ce0a-5399-851e-7ae69a84a2fc with scrape type 2
2026-03-30 11:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f416dc-ce0a-5399-851e-7ae69a84a2fc with scrape type 2
2026-03-30 11:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 97f416dc-ce0a-5399-851e-7ae69a84a2fc, identifier: PV43635
2026-03-30 11:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 97f416dc-ce0a-5399-851e-7ae69a84a2fc with identifier: PV43635
2026-03-30 11:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 97f416dc-ce0a-5399-851e-7ae69a84a2fc with identifier: PV43635
2026-03-30 11:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 97f416dc-ce0a-5399-851e-7ae69a84a2fc with identifier: PV43635 to the API
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:51:15Z',
 'fuel_type': 'petrol',
 'id': '97f416dc-ce0a-5399-851e-7ae69a84a2fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV43635',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 66156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-16',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 e-THP Vitamine',
 'transmission': 'manual',
 'trim': 'Vitamine',
 'year': 2016}
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV43635%27 HTTP/1.1" 200 None
2026-03-30 11:38:49 [auto1.be] INFO: Saving data for PV43635: {'auction_closing_time': 1774972275.0, 'created_time': 1774002092.843894, 'last_price_update_time': 1774870729.435864}
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV43635') HTTP/1.1" 204 0
2026-03-30 11:38:49 [auto1.be] INFO: Found listing with ID: UW31030
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW31030%27 HTTP/1.1" 200 None
2026-03-30 11:38:49 [auto1.be] INFO: Scrape type for UW31030: 2
2026-03-30 11:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48bf83a9-6dab-5632-84ce-908b6c5c035a with identifier: UW31030
2026-03-30 11:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48bf83a9-6dab-5632-84ce-908b6c5c035a with scrape type 2
2026-03-30 11:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48bf83a9-6dab-5632-84ce-908b6c5c035a with scrape type 2
2026-03-30 11:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 48bf83a9-6dab-5632-84ce-908b6c5c035a, identifier: UW31030
2026-03-30 11:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 48bf83a9-6dab-5632-84ce-908b6c5c035a with identifier: UW31030
2026-03-30 11:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 48bf83a9-6dab-5632-84ce-908b6c5c035a with identifier: UW31030
2026-03-30 11:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 48bf83a9-6dab-5632-84ce-908b6c5c035a with identifier: UW31030 to the API
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:47:27Z',
 'fuel_type': 'petrol',
 'id': '48bf83a9-6dab-5632-84ce-908b6c5c035a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW31030',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 135177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-13',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW31030%27 HTTP/1.1" 200 None
2026-03-30 11:38:49 [auto1.be] INFO: Saving data for UW31030: {'auction_closing_time': 1774972047.0, 'created_time': 1774039056.886914, 'last_price_update_time': 1774870729.878246}
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW31030') HTTP/1.1" 204 0
2026-03-30 11:38:49 [auto1.be] INFO: Found listing with ID: TG84892
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG84892%27 HTTP/1.1" 200 None
2026-03-30 11:38:49 [auto1.be] INFO: Scrape type for TG84892: 2
2026-03-30 11:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d481d3-a2d5-5438-961c-0c675876247a with identifier: TG84892
2026-03-30 11:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d481d3-a2d5-5438-961c-0c675876247a with scrape type 2
2026-03-30 11:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29d481d3-a2d5-5438-961c-0c675876247a with scrape type 2
2026-03-30 11:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29d481d3-a2d5-5438-961c-0c675876247a, identifier: TG84892
2026-03-30 11:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY86214> (referer: https://www.auto1.com/v1/car-details-view/AY86214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29d481d3-a2d5-5438-961c-0c675876247a with identifier: TG84892
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29d481d3-a2d5-5438-961c-0c675876247a with identifier: TG84892
2026-03-30 11:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29d481d3-a2d5-5438-961c-0c675876247a with identifier: TG84892 to the API
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:55:35Z',
 'fuel_type': 'diesel',
 'id': '29d481d3-a2d5-5438-961c-0c675876247a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG84892',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 100840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-08',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2019}
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG84892%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [auto1.be] INFO: Saving data for TG84892: {'auction_closing_time': 1774972535.0, 'created_time': 1774298203.398445, 'last_price_update_time': 1774870730.508204}
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TG84892') HTTP/1.1" 204 0
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU90120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR73371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cb7a6c5-ad67-5576-8595-19cb1bd2db88 with identifier: AY86214
2026-03-30 11:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88 with scrape type 1
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_d13bfac7d18e428f9d0fdf918306b8be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d13bfac7d18e428f9d0fdf918306b8be.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_ca9a7e196938f211b662f72c7e295870.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_ca9a7e196938f211b662f72c7e295870.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_85ed224c363a442f5092e42a9aa6096d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_85ed224c363a442f5092e42a9aa6096d.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_6fe80333d81b5025dd20b2b9fa04dfa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_6fe80333d81b5025dd20b2b9fa04dfa3.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_58a24b8bc2560be76694511445c6d7d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_58a24b8bc2560be76694511445c6d7d8.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_3f8d46839c984a5be8186e726e4dc64a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_3f8d46839c984a5be8186e726e4dc64a.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_723f664b52e8abf6c72271a2db002d01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_723f664b52e8abf6c72271a2db002d01.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_d7cf3b8c6b59051d9b9c8b4d0347f7aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d7cf3b8c6b59051d9b9c8b4d0347f7aa.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_f14829c73d14145050872bef2e66acbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_f14829c73d14145050872bef2e66acbe.jpg not downloaded yet
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_504583aa6e6c1e35952fac3fcb79d998.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_504583aa6e6c1e35952fac3fcb79d998.jpg not downloaded yet
2026-03-30 11:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG33358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_504583aa6e6c1e35952fac3fcb79d998.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_f14829c73d14145050872bef2e66acbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc952b10>
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_504583aa6e6c1e35952fac3fcb79d998.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_504583aa6e6c1e35952fac3fcb79d998.jpg saved to cache
2026-03-30 11:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86c090>
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_f14829c73d14145050872bef2e66acbe.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_f14829c73d14145050872bef2e66acbe.jpg saved to cache
2026-03-30 11:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML14183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d7cf3b8c6b59051d9b9c8b4d0347f7aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc949710>
2026-03-30 11:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_d7cf3b8c6b59051d9b9c8b4d0347f7aa.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d7cf3b8c6b59051d9b9c8b4d0347f7aa.jpg saved to cache
2026-03-30 11:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP83103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.731(s), this was the 1st time calling it.
2026-03-30 11:38:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.511352012455906 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:39:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.376(s), this was the 1st time calling it.
2026-03-30 11:39:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.189448512065937 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:39:06 [scrapy.extensions.logstats] INFO: Crawled 33 pages (at 12 pages/min), scraped 29 items (at 14 items/min)
2026-03-30 11:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-30 11:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW96684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG04506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL68668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR51057> (referer: https://www.auto1.com/v1/car-details-view/BR51057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07f99291-a26b-5a58-96b9-e7d7b8033e56 with identifier: BR51057
2026-03-30 11:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f99291-a26b-5a58-96b9-e7d7b8033e56 with scrape type 1
2026-03-30 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 07f99291-a26b-5a58-96b9-e7d7b8033e56
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_9f9e0254c6b95e0e1d31ef9dc3a8ca25.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_9f9e0254c6b95e0e1d31ef9dc3a8ca25.jpg not downloaded yet
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_a381f5d754235178b10b24247d286022.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_a381f5d754235178b10b24247d286022.jpg not downloaded yet
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_f6ad659dc85a16aa330ea53946914616.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_f6ad659dc85a16aa330ea53946914616.jpg not downloaded yet
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_1491612a0a8cdf50a7bfefaa9653d39e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_1491612a0a8cdf50a7bfefaa9653d39e.jpg not downloaded yet
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_2745d6177403119dd3d8a534d727d9cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_2745d6177403119dd3d8a534d727d9cb.jpg not downloaded yet
2026-03-30 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_44a81b39b5cdadbe3161001dfe019a7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_44a81b39b5cdadbe3161001dfe019a7a.jpg not downloaded yet
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP20527> (referer: https://www.auto1.com/v1/car-details-view/LP20527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_44a81b39b5cdadbe3161001dfe019a7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29334984-d964-5137-b68e-958ee457fbe5 with identifier: LP20527
2026-03-30 11:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29334984-d964-5137-b68e-958ee457fbe5 with scrape type 1
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_be88858aa9e1bad4da6ef630a3b9827f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_be88858aa9e1bad4da6ef630a3b9827f.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_99832ae90668654794fbc4a4a332c43e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_99832ae90668654794fbc4a4a332c43e.jpg not downloaded yet
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_2745d6177403119dd3d8a534d727d9cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_4d2af5348a53a90db075c7f48cfd4643.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_4d2af5348a53a90db075c7f48cfd4643.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_de30f65e0f0165759bf288791af5ce30.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_de30f65e0f0165759bf288791af5ce30.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_850e66918c7045b3b58689448da76e05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_850e66918c7045b3b58689448da76e05.jpg not downloaded yet
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc817690>
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_44a81b39b5cdadbe3161001dfe019a7a.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_44a81b39b5cdadbe3161001dfe019a7a.jpg saved to cache
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07f99291-a26b-5a58-96b9-e7d7b8033e56
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_7c9ae89ab9159b83195da2ec6f434f2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_7c9ae89ab9159b83195da2ec6f434f2b.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_865c581c90b675612e6126655bbce3d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_865c581c90b675612e6126655bbce3d6.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_bf388cb572c73900782ffae368a6ee89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_bf388cb572c73900782ffae368a6ee89.jpg not downloaded yet
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc89d290>
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_2745d6177403119dd3d8a534d727d9cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_2745d6177403119dd3d8a534d727d9cb.jpg saved to cache
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07f99291-a26b-5a58-96b9-e7d7b8033e56
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_3d58b203f810a5edf178d47953f6cd9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_3d58b203f810a5edf178d47953f6cd9b.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_af20d04cfb0c82aaed33c5382e36f443.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_af20d04cfb0c82aaed33c5382e36f443.jpg not downloaded yet
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_be88858aa9e1bad4da6ef630a3b9827f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_af20d04cfb0c82aaed33c5382e36f443.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_3d58b203f810a5edf178d47953f6cd9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:39:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:39:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc960490>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_be88858aa9e1bad4da6ef630a3b9827f.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_be88858aa9e1bad4da6ef630a3b9827f.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_bf388cb572c73900782ffae368a6ee89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc825510>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_af20d04cfb0c82aaed33c5382e36f443.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_af20d04cfb0c82aaed33c5382e36f443.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc935c50>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_3d58b203f810a5edf178d47953f6cd9b.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_3d58b203f810a5edf178d47953f6cd9b.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de861b10>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_bf388cb572c73900782ffae368a6ee89.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_bf388cb572c73900782ffae368a6ee89.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_865c581c90b675612e6126655bbce3d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_7c9ae89ab9159b83195da2ec6f434f2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK26681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_850e66918c7045b3b58689448da76e05.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc914810>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_865c581c90b675612e6126655bbce3d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_865c581c90b675612e6126655bbce3d6.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_4d2af5348a53a90db075c7f48cfd4643.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc883f10>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_7c9ae89ab9159b83195da2ec6f434f2b.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_7c9ae89ab9159b83195da2ec6f434f2b.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca51b90>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_850e66918c7045b3b58689448da76e05.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_850e66918c7045b3b58689448da76e05.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_de30f65e0f0165759bf288791af5ce30.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_99832ae90668654794fbc4a4a332c43e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0e190>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_4d2af5348a53a90db075c7f48cfd4643.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_4d2af5348a53a90db075c7f48cfd4643.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_1491612a0a8cdf50a7bfefaa9653d39e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_f6ad659dc85a16aa330ea53946914616.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc900450>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_de30f65e0f0165759bf288791af5ce30.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_de30f65e0f0165759bf288791af5ce30.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_a381f5d754235178b10b24247d286022.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7bbd10>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F28%252Fd128e86a75a0dbcec98dd93722f0e718%252Fpa%252FLP20527_99832ae90668654794fbc4a4a332c43e.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_99832ae90668654794fbc4a4a332c43e.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29334984-d964-5137-b68e-958ee457fbe5
2026-03-30 11:39:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29334984-d964-5137-b68e-958ee457fbe5, skipping ID generation
2026-03-30 11:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29334984-d964-5137-b68e-958ee457fbe5 with scrape type 1
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29334984-d964-5137-b68e-958ee457fbe5 sending to next pipeline
2026-03-30 11:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29334984-d964-5137-b68e-958ee457fbe5, identifier: LP20527
2026-03-30 11:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29334984-d964-5137-b68e-958ee457fbe5 with identifier: LP20527
2026-03-30 11:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29334984-d964-5137-b68e-958ee457fbe5 with identifier: LP20527
2026-03-30 11:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29334984-d964-5137-b68e-958ee457fbe5 with identifier: LP20527 to the API
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_99832ae90668654794fbc4a4a332c43e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:17:14Z',
 'fuel_type': 'petrol',
 'id': '29334984-d964-5137-b68e-958ee457fbe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP20527',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 289575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3976216,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_be88858aa9e1bad4da6ef630a3b9827f.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_99832ae90668654794fbc4a4a332c43e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_4d2af5348a53a90db075c7f48cfd4643.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_de30f65e0f0165759bf288791af5ce30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_850e66918c7045b3b58689448da76e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_7c9ae89ab9159b83195da2ec6f434f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_865c581c90b675612e6126655bbce3d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_bf388cb572c73900782ffae368a6ee89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_3d58b203f810a5edf178d47953f6cd9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29334984-d964-5137-b68e-958ee457fbe5/29334984-d964-5137-b68e-958ee457fbe5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/28/d128e86a75a0dbcec98dd93722f0e718/pa/LP20527_af20d04cfb0c82aaed33c5382e36f443.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP20527%27 HTTP/1.1" 200 None
2026-03-30 11:39:20 [auto1.be] INFO: Saving data for LP20527: {'created_time': 1774870760.384065, 'last_price_update_time': 1774870760.384076, 'auction_closing_time': 1774970234.0}
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP20527') HTTP/1.1" 204 0
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc888850>
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_1491612a0a8cdf50a7bfefaa9653d39e.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_1491612a0a8cdf50a7bfefaa9653d39e.jpg saved to cache
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07f99291-a26b-5a58-96b9-e7d7b8033e56
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75a590>
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_f6ad659dc85a16aa330ea53946914616.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_f6ad659dc85a16aa330ea53946914616.jpg saved to cache
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07f99291-a26b-5a58-96b9-e7d7b8033e56
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc766ad0>
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_a381f5d754235178b10b24247d286022.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_a381f5d754235178b10b24247d286022.jpg saved to cache
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07f99291-a26b-5a58-96b9-e7d7b8033e56
2026-03-30 11:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_9f9e0254c6b95e0e1d31ef9dc3a8ca25.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75b5d0>
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F4e%252Faf4e3d2d6ea8e54dd99245add96f4e9f%252Fpa%252FBR51057_9f9e0254c6b95e0e1d31ef9dc3a8ca25.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_9f9e0254c6b95e0e1d31ef9dc3a8ca25.jpg saved to cache
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07f99291-a26b-5a58-96b9-e7d7b8033e56
2026-03-30 11:39:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07f99291-a26b-5a58-96b9-e7d7b8033e56, skipping ID generation
2026-03-30 11:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f99291-a26b-5a58-96b9-e7d7b8033e56 with scrape type 1
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07f99291-a26b-5a58-96b9-e7d7b8033e56 sending to next pipeline
2026-03-30 11:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07f99291-a26b-5a58-96b9-e7d7b8033e56, identifier: BR51057
2026-03-30 11:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07f99291-a26b-5a58-96b9-e7d7b8033e56 with identifier: BR51057
2026-03-30 11:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07f99291-a26b-5a58-96b9-e7d7b8033e56 with identifier: BR51057
2026-03-30 11:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07f99291-a26b-5a58-96b9-e7d7b8033e56 with identifier: BR51057 to the API
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_9f9e0254c6b95e0e1d31ef9dc3a8ca25.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:59:00Z',
 'fuel_type': 'petrol',
 'id': '07f99291-a26b-5a58-96b9-e7d7b8033e56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR51057',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 160559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_9f9e0254c6b95e0e1d31ef9dc3a8ca25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_a381f5d754235178b10b24247d286022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_f6ad659dc85a16aa330ea53946914616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_1491612a0a8cdf50a7bfefaa9653d39e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_2745d6177403119dd3d8a534d727d9cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f99291-a26b-5a58-96b9-e7d7b8033e56/07f99291-a26b-5a58-96b9-e7d7b8033e56_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/4e/af4e3d2d6ea8e54dd99245add96f4e9f/pa/BR51057_44a81b39b5cdadbe3161001dfe019a7a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR51057%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Saving data for BR51057: {'created_time': 1774870761.215676, 'last_price_update_time': 1774870761.215687, 'auction_closing_time': 1774972740.0}
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR51057') HTTP/1.1" 204 0
2026-03-30 11:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH57000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_723f664b52e8abf6c72271a2db002d01.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_3f8d46839c984a5be8186e726e4dc64a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc855950>
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_723f664b52e8abf6c72271a2db002d01.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_723f664b52e8abf6c72271a2db002d01.jpg saved to cache
2026-03-30 11:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75be90>
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_3f8d46839c984a5be8186e726e4dc64a.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_3f8d46839c984a5be8186e726e4dc64a.jpg saved to cache
2026-03-30 11:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:39:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.473(s), this was the 1st time calling it.
2026-03-30 11:39:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.4282663858223428 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA85279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_58a24b8bc2560be76694511445c6d7d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_6fe80333d81b5025dd20b2b9fa04dfa3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcaa0850>
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_58a24b8bc2560be76694511445c6d7d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_58a24b8bc2560be76694511445c6d7d8.jpg saved to cache
2026-03-30 11:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75ba50>
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_6fe80333d81b5025dd20b2b9fa04dfa3.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_6fe80333d81b5025dd20b2b9fa04dfa3.jpg saved to cache
2026-03-30 11:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF96897> (referer: https://www.auto1.com/v1/car-details-view/UF96897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_85ed224c363a442f5092e42a9aa6096d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a794403f-e8ca-52f1-a01c-2d902cfb0fd9 with identifier: UF96897
2026-03-30 11:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9 with scrape type 1
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_7d9e1f7c5fdd97d952bd5a13804e0f01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_7d9e1f7c5fdd97d952bd5a13804e0f01.jpg not downloaded yet
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_676b1eb1c6a5fb67d29195d03d1a17b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_676b1eb1c6a5fb67d29195d03d1a17b4.jpg not downloaded yet
2026-03-30 11:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_ca9a7e196938f211b662f72c7e295870.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_445a5fd444549d222984f64cc8278047.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_445a5fd444549d222984f64cc8278047.jpg not downloaded yet
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_3147ff44f9d53a3a49b7de57fc757a0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_3147ff44f9d53a3a49b7de57fc757a0b.jpg not downloaded yet
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_71886d94dd4ec608f3a22370e1a14508.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_71886d94dd4ec608f3a22370e1a14508.jpg not downloaded yet
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_d1e8f4fa4b7b796b65682260a314877c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_d1e8f4fa4b7b796b65682260a314877c.jpg not downloaded yet
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc700a10>
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_85ed224c363a442f5092e42a9aa6096d.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_85ed224c363a442f5092e42a9aa6096d.jpg saved to cache
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_97663494cfad5c77015cdeb8a7597782.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_97663494cfad5c77015cdeb8a7597782.jpg not downloaded yet
2026-03-30 11:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_676b1eb1c6a5fb67d29195d03d1a17b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_16954c3f7df5c44598be256e5dc47d74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_16954c3f7df5c44598be256e5dc47d74.jpg not downloaded yet
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_c1ec76c6c474934b70036c5bf3101b14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_c1ec76c6c474934b70036c5bf3101b14.jpg not downloaded yet
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc715010>
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_ca9a7e196938f211b662f72c7e295870.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_ca9a7e196938f211b662f72c7e295870.jpg saved to cache
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_fb7e7ddb76d0f21def68d3106e68c8b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_fb7e7ddb76d0f21def68d3106e68c8b7.jpg not downloaded yet
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca57710>
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_676b1eb1c6a5fb67d29195d03d1a17b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_676b1eb1c6a5fb67d29195d03d1a17b4.jpg saved to cache
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR73371> (referer: https://www.auto1.com/v1/car-details-view/KR73371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_d1e8f4fa4b7b796b65682260a314877c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2a92b2-1fd4-5363-92e7-723a22d729a8 with identifier: KR73371
2026-03-30 11:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8 with scrape type 1
2026-03-30 11:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_588f188565eb574e89bb2ecac5babfe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_588f188565eb574e89bb2ecac5babfe8.jpg not downloaded yet
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_fb7e7ddb76d0f21def68d3106e68c8b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_0c89f99a4758f4a5199b5ffad4314365.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_0c89f99a4758f4a5199b5ffad4314365.jpg not downloaded yet
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_848a387cfee58d4675d4559682fd5bbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_848a387cfee58d4675d4559682fd5bbd.jpg not downloaded yet
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb21450>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_d1e8f4fa4b7b796b65682260a314877c.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_d1e8f4fa4b7b796b65682260a314877c.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_de61991fc67515c871f6a3396ae3be68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_de61991fc67515c871f6a3396ae3be68.jpg not downloaded yet
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_588f188565eb574e89bb2ecac5babfe8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_cec13c59789b086bb5d9248da00c99ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_cec13c59789b086bb5d9248da00c99ce.jpg not downloaded yet
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_c1ec76c6c474934b70036c5bf3101b14.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_09a037a32c9294758a536267151447a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_09a037a32c9294758a536267151447a0.jpg not downloaded yet
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83b290>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_fb7e7ddb76d0f21def68d3106e68c8b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_fb7e7ddb76d0f21def68d3106e68c8b7.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_848a387cfee58d4675d4559682fd5bbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_c7cd03592abf085d8d1cc8e26c49e1a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c7cd03592abf085d8d1cc8e26c49e1a0.jpg not downloaded yet
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_b2d66185af89f335e550b9fedc9b657e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_b2d66185af89f335e550b9fedc9b657e.jpg not downloaded yet
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_c614fd11e51f3f6095f02d439a856ce9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c614fd11e51f3f6095f02d439a856ce9.jpg not downloaded yet
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc758b90>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_588f188565eb574e89bb2ecac5babfe8.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_588f188565eb574e89bb2ecac5babfe8.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_8a4836a304f1c82c003d76ff54287ede.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_8a4836a304f1c82c003d76ff54287ede.jpg not downloaded yet
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_cec13c59789b086bb5d9248da00c99ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_09a037a32c9294758a536267151447a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc950d10>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_c1ec76c6c474934b70036c5bf3101b14.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_c1ec76c6c474934b70036c5bf3101b14.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8da2d0>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_848a387cfee58d4675d4559682fd5bbd.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_848a387cfee58d4675d4559682fd5bbd.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc825610>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_cec13c59789b086bb5d9248da00c99ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_cec13c59789b086bb5d9248da00c99ce.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc92a7d0>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_09a037a32c9294758a536267151447a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_09a037a32c9294758a536267151447a0.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_b2d66185af89f335e550b9fedc9b657e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c614fd11e51f3f6095f02d439a856ce9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_8a4836a304f1c82c003d76ff54287ede.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c7cd03592abf085d8d1cc8e26c49e1a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_de61991fc67515c871f6a3396ae3be68.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_0c89f99a4758f4a5199b5ffad4314365.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc921ed0>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_b2d66185af89f335e550b9fedc9b657e.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_b2d66185af89f335e550b9fedc9b657e.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9508d0>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_c614fd11e51f3f6095f02d439a856ce9.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c614fd11e51f3f6095f02d439a856ce9.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_97663494cfad5c77015cdeb8a7597782.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcaa33d0>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_8a4836a304f1c82c003d76ff54287ede.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_8a4836a304f1c82c003d76ff54287ede.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc895a10>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_c7cd03592abf085d8d1cc8e26c49e1a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c7cd03592abf085d8d1cc8e26c49e1a0.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8e9050>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_de61991fc67515c871f6a3396ae3be68.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_de61991fc67515c871f6a3396ae3be68.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc895e10>
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F3b%252F6f3b223425f3feb31cab807a19071347%252Fpa%252FKR73371_0c89f99a4758f4a5199b5ffad4314365.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_0c89f99a4758f4a5199b5ffad4314365.jpg saved to cache
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8
2026-03-30 11:39:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c2a92b2-1fd4-5363-92e7-723a22d729a8, skipping ID generation
2026-03-30 11:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8 with scrape type 1
2026-03-30 11:39:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c2a92b2-1fd4-5363-92e7-723a22d729a8 sending to next pipeline
2026-03-30 11:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c2a92b2-1fd4-5363-92e7-723a22d729a8, identifier: KR73371
2026-03-30 11:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_16954c3f7df5c44598be256e5dc47d74.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c2a92b2-1fd4-5363-92e7-723a22d729a8 with identifier: KR73371
2026-03-30 11:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c2a92b2-1fd4-5363-92e7-723a22d729a8 with identifier: KR73371
2026-03-30 11:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c2a92b2-1fd4-5363-92e7-723a22d729a8 with identifier: KR73371 to the API
2026-03-30 11:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_0c89f99a4758f4a5199b5ffad4314365.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:35:49Z',
 'fuel_type': 'diesel',
 'id': '2c2a92b2-1fd4-5363-92e7-723a22d729a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR73371',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 118220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_588f188565eb574e89bb2ecac5babfe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_0c89f99a4758f4a5199b5ffad4314365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_848a387cfee58d4675d4559682fd5bbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_de61991fc67515c871f6a3396ae3be68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_cec13c59789b086bb5d9248da00c99ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_09a037a32c9294758a536267151447a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c7cd03592abf085d8d1cc8e26c49e1a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_b2d66185af89f335e550b9fedc9b657e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_c614fd11e51f3f6095f02d439a856ce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2a92b2-1fd4-5363-92e7-723a22d729a8/2c2a92b2-1fd4-5363-92e7-723a22d729a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/3b/6f3b223425f3feb31cab807a19071347/pa/KR73371_8a4836a304f1c82c003d76ff54287ede.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR73371%27 HTTP/1.1" 200 None
2026-03-30 11:39:45 [auto1.be] INFO: Saving data for KR73371: {'created_time': 1774870785.515163, 'last_price_update_time': 1774870785.515172, 'auction_closing_time': 1774971349.0}
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR73371') HTTP/1.1" 204 0
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc887850>
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_97663494cfad5c77015cdeb8a7597782.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_97663494cfad5c77015cdeb8a7597782.jpg saved to cache
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_71886d94dd4ec608f3a22370e1a14508.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6ead90>
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_16954c3f7df5c44598be256e5dc47d74.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_16954c3f7df5c44598be256e5dc47d74.jpg saved to cache
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73debc7190>
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_71886d94dd4ec608f3a22370e1a14508.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_71886d94dd4ec608f3a22370e1a14508.jpg saved to cache
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_445a5fd444549d222984f64cc8278047.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_7d9e1f7c5fdd97d952bd5a13804e0f01.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_3147ff44f9d53a3a49b7de57fc757a0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d13bfac7d18e428f9d0fdf918306b8be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc764510>
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_445a5fd444549d222984f64cc8278047.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_445a5fd444549d222984f64cc8278047.jpg saved to cache
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7141d0>
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_7d9e1f7c5fdd97d952bd5a13804e0f01.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_7d9e1f7c5fdd97d952bd5a13804e0f01.jpg saved to cache
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc991510>
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F55%252Ff755dfe0131ac95f00ed279cec94b985%252Fpa%252FUF96897_3147ff44f9d53a3a49b7de57fc757a0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_3147ff44f9d53a3a49b7de57fc757a0b.jpg saved to cache
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9
2026-03-30 11:39:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a794403f-e8ca-52f1-a01c-2d902cfb0fd9, skipping ID generation
2026-03-30 11:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9 with scrape type 1
2026-03-30 11:39:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a794403f-e8ca-52f1-a01c-2d902cfb0fd9 sending to next pipeline
2026-03-30 11:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a794403f-e8ca-52f1-a01c-2d902cfb0fd9, identifier: UF96897
2026-03-30 11:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6f28d0>
2026-03-30 11:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F6f%252Ff06f0125c42d137c50c983ac1be94900%252Fpa%252FAY86214_d13bfac7d18e428f9d0fdf918306b8be.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d13bfac7d18e428f9d0fdf918306b8be.jpg saved to cache
2026-03-30 11:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88
2026-03-30 11:39:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cb7a6c5-ad67-5576-8595-19cb1bd2db88, skipping ID generation
2026-03-30 11:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88 with scrape type 1
2026-03-30 11:39:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cb7a6c5-ad67-5576-8595-19cb1bd2db88 sending to next pipeline
2026-03-30 11:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0cb7a6c5-ad67-5576-8595-19cb1bd2db88, identifier: AY86214
2026-03-30 11:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a794403f-e8ca-52f1-a01c-2d902cfb0fd9 with identifier: UF96897
2026-03-30 11:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a794403f-e8ca-52f1-a01c-2d902cfb0fd9 with identifier: UF96897
2026-03-30 11:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a794403f-e8ca-52f1-a01c-2d902cfb0fd9 with identifier: UF96897 to the API
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_3147ff44f9d53a3a49b7de57fc757a0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:58:36Z',
 'fuel_type': 'diesel',
 'id': 'a794403f-e8ca-52f1-a01c-2d902cfb0fd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF96897',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 181313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_7d9e1f7c5fdd97d952bd5a13804e0f01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_676b1eb1c6a5fb67d29195d03d1a17b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_445a5fd444549d222984f64cc8278047.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_3147ff44f9d53a3a49b7de57fc757a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_71886d94dd4ec608f3a22370e1a14508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_d1e8f4fa4b7b796b65682260a314877c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_97663494cfad5c77015cdeb8a7597782.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_16954c3f7df5c44598be256e5dc47d74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_c1ec76c6c474934b70036c5bf3101b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a794403f-e8ca-52f1-a01c-2d902cfb0fd9/a794403f-e8ca-52f1-a01c-2d902cfb0fd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/55/f755dfe0131ac95f00ed279cec94b985/pa/UF96897_fb7e7ddb76d0f21def68d3106e68c8b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Night & Day',
 'transmission': 'manual',
 'trim': 'Night & Day',
 'year': 2011}
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF96897%27 HTTP/1.1" 200 None
2026-03-30 11:39:46 [auto1.be] INFO: Saving data for UF96897: {'created_time': 1774870786.514854, 'last_price_update_time': 1774870786.514863, 'auction_closing_time': 1774972716.0}
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF96897') HTTP/1.1" 204 0
2026-03-30 11:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0cb7a6c5-ad67-5576-8595-19cb1bd2db88 with identifier: AY86214
2026-03-30 11:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0cb7a6c5-ad67-5576-8595-19cb1bd2db88 with identifier: AY86214
2026-03-30 11:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0cb7a6c5-ad67-5576-8595-19cb1bd2db88 with identifier: AY86214 to the API
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d13bfac7d18e428f9d0fdf918306b8be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:46Z',
 'fuel_type': 'diesel',
 'id': '0cb7a6c5-ad67-5576-8595-19cb1bd2db88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY86214',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 133822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d13bfac7d18e428f9d0fdf918306b8be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_ca9a7e196938f211b662f72c7e295870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_85ed224c363a442f5092e42a9aa6096d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_6fe80333d81b5025dd20b2b9fa04dfa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_58a24b8bc2560be76694511445c6d7d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_3f8d46839c984a5be8186e726e4dc64a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_723f664b52e8abf6c72271a2db002d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_d7cf3b8c6b59051d9b9c8b4d0347f7aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_f14829c73d14145050872bef2e66acbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cb7a6c5-ad67-5576-8595-19cb1bd2db88/0cb7a6c5-ad67-5576-8595-19cb1bd2db88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/6f/f06f0125c42d137c50c983ac1be94900/pa/AY86214_504583aa6e6c1e35952fac3fcb79d998.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY86214%27 HTTP/1.1" 200 None
2026-03-30 11:39:46 [auto1.be] INFO: Saving data for AY86214: {'created_time': 1774870786.976118, 'last_price_update_time': 1774870786.976129, 'auction_closing_time': 1774970086.0}
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY86214') HTTP/1.1" 204 0
2026-03-30 11:40:06 [scrapy.extensions.logstats] INFO: Crawled 43 pages (at 10 pages/min), scraped 34 items (at 5 items/min)
2026-03-30 11:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 11:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML14183> (referer: https://www.auto1.com/v1/car-details-view/ML14183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b44cef7-adf2-5e16-99de-685b5d36a401 with identifier: ML14183
2026-03-30 11:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b44cef7-adf2-5e16-99de-685b5d36a401 with scrape type 1
2026-03-30 11:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1b44cef7-adf2-5e16-99de-685b5d36a401
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_09371058d112c101e2c6af853a3c8040.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_09371058d112c101e2c6af853a3c8040.jpg not downloaded yet
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_e23af5a415084a7a6ad156e1aa7fae3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_e23af5a415084a7a6ad156e1aa7fae3c.jpg not downloaded yet
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_0ca6efc1eb01debb4b54477d0006c9ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_0ca6efc1eb01debb4b54477d0006c9ab.jpg not downloaded yet
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_7a1f86b9a6b67e7513099ec47632573e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_7a1f86b9a6b67e7513099ec47632573e.jpg not downloaded yet
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_58d1b710795acf20a7021dfff03a6f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_58d1b710795acf20a7021dfff03a6f5d.jpg not downloaded yet
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_75481fe6ca5543ff5e8898f46d0f95f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_75481fe6ca5543ff5e8898f46d0f95f7.jpg not downloaded yet
2026-03-30 11:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP83103> (referer: https://www.auto1.com/v1/car-details-view/AP83103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984f8c42-8ef6-5b73-ab7c-fac3ec8377f6 with identifier: AP83103
2026-03-30 11:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984f8c42-8ef6-5b73-ab7c-fac3ec8377f6 with scrape type 1
2026-03-30 11:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 984f8c42-8ef6-5b73-ab7c-fac3ec8377f6
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F63%252F76632221f70a956106185281beb2aaad%252Fpa%252FAP83103_86bf4402ae339913e1435bf4a6b81630.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_86bf4402ae339913e1435bf4a6b81630.jpg already downloaded
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F63%252F76632221f70a956106185281beb2aaad%252Fpa%252FAP83103_f534a12f90658e7bb81dee28295f26de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f534a12f90658e7bb81dee28295f26de.jpg already downloaded
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F63%252F76632221f70a956106185281beb2aaad%252Fpa%252FAP83103_f37fbfcdee9b2aedf251f73d15275864.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f37fbfcdee9b2aedf251f73d15275864.jpg already downloaded
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F63%252F76632221f70a956106185281beb2aaad%252Fpa%252FAP83103_7a53640641cae6720ca293578bf2cd74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_7a53640641cae6720ca293578bf2cd74.jpg already downloaded
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F63%252F76632221f70a956106185281beb2aaad%252Fpa%252FAP83103_f5166d1165d40cec7fd3dc6c25b7fd4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f5166d1165d40cec7fd3dc6c25b7fd4f.jpg already downloaded
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F63%252F76632221f70a956106185281beb2aaad%252Fpa%252FAP83103_0c92062fd561d8b07509b62e18fcf32d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_0c92062fd561d8b07509b62e18fcf32d.jpg already downloaded
2026-03-30 11:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 984f8c42-8ef6-5b73-ab7c-fac3ec8377f6, identifier: AP83103
2026-03-30 11:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 984f8c42-8ef6-5b73-ab7c-fac3ec8377f6 with identifier: AP83103
2026-03-30 11:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 984f8c42-8ef6-5b73-ab7c-fac3ec8377f6 with identifier: AP83103
2026-03-30 11:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 984f8c42-8ef6-5b73-ab7c-fac3ec8377f6 with identifier: AP83103 to the API
2026-03-30 11:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AP83103>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:27:12Z',
 'fuel_type': 'diesel',
 'id': '984f8c42-8ef6-5b73-ab7c-fac3ec8377f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP83103',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 198998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_86bf4402ae339913e1435bf4a6b81630.jpg',
                'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f534a12f90658e7bb81dee28295f26de.jpg',
                'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f37fbfcdee9b2aedf251f73d15275864.jpg',
                'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_7a53640641cae6720ca293578bf2cd74.jpg',
                'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f5166d1165d40cec7fd3dc6c25b7fd4f.jpg',
                'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_0c92062fd561d8b07509b62e18fcf32d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984f8c42-8ef6-5b73-ab7c-fac3ec8377f6/984f8c42-8ef6-5b73-ab7c-fac3ec8377f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_86bf4402ae339913e1435bf4a6b81630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984f8c42-8ef6-5b73-ab7c-fac3ec8377f6/984f8c42-8ef6-5b73-ab7c-fac3ec8377f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f534a12f90658e7bb81dee28295f26de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984f8c42-8ef6-5b73-ab7c-fac3ec8377f6/984f8c42-8ef6-5b73-ab7c-fac3ec8377f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f37fbfcdee9b2aedf251f73d15275864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984f8c42-8ef6-5b73-ab7c-fac3ec8377f6/984f8c42-8ef6-5b73-ab7c-fac3ec8377f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_7a53640641cae6720ca293578bf2cd74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984f8c42-8ef6-5b73-ab7c-fac3ec8377f6/984f8c42-8ef6-5b73-ab7c-fac3ec8377f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_f5166d1165d40cec7fd3dc6c25b7fd4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_984f8c42-8ef6-5b73-ab7c-fac3ec8377f6/984f8c42-8ef6-5b73-ab7c-fac3ec8377f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/63/76632221f70a956106185281beb2aaad/pa/AP83103_0c92062fd561d8b07509b62e18fcf32d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra GTC 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP83103%27 HTTP/1.1" 200 None
2026-03-30 11:40:51 [auto1.be] INFO: Saving data for AP83103: {'created_time': 1774870851.18304, 'last_price_update_time': 1774870851.18305, 'auction_closing_time': 1774970832.0}
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP83103') HTTP/1.1" 204 0
2026-03-30 11:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_75481fe6ca5543ff5e8898f46d0f95f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc830890>
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_75481fe6ca5543ff5e8898f46d0f95f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_75481fe6ca5543ff5e8898f46d0f95f7.jpg saved to cache
2026-03-30 11:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b44cef7-adf2-5e16-99de-685b5d36a401
2026-03-30 11:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_58d1b710795acf20a7021dfff03a6f5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7175d0>
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_58d1b710795acf20a7021dfff03a6f5d.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_58d1b710795acf20a7021dfff03a6f5d.jpg saved to cache
2026-03-30 11:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b44cef7-adf2-5e16-99de-685b5d36a401
2026-03-30 11:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_7a1f86b9a6b67e7513099ec47632573e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71d7d0>
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_7a1f86b9a6b67e7513099ec47632573e.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_7a1f86b9a6b67e7513099ec47632573e.jpg saved to cache
2026-03-30 11:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b44cef7-adf2-5e16-99de-685b5d36a401
2026-03-30 11:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_0ca6efc1eb01debb4b54477d0006c9ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW96684> (referer: https://www.auto1.com/v1/car-details-view/YW96684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc716390>
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_0ca6efc1eb01debb4b54477d0006c9ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_0ca6efc1eb01debb4b54477d0006c9ab.jpg saved to cache
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b44cef7-adf2-5e16-99de-685b5d36a401
2026-03-30 11:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d with identifier: YW96684
2026-03-30 11:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d with scrape type 1
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_26b8d91afac647337758b5e110b6394a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_26b8d91afac647337758b5e110b6394a.jpg not downloaded yet
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_de15daf6c8122981f3384a5a32dddda5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_de15daf6c8122981f3384a5a32dddda5.jpg not downloaded yet
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_498fa021d41c1a841d3563e2aa75c45f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_498fa021d41c1a841d3563e2aa75c45f.jpg not downloaded yet
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_4ddff83d598e13faa782a61b20e3d429.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4ddff83d598e13faa782a61b20e3d429.jpg not downloaded yet
2026-03-30 11:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_e23af5a415084a7a6ad156e1aa7fae3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_09371058d112c101e2c6af853a3c8040.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_3c9012c2d98875950704fa842a1b0ef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_3c9012c2d98875950704fa842a1b0ef7.jpg not downloaded yet
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_2bfe7adaa98494a7a331e6ee16308b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_2bfe7adaa98494a7a331e6ee16308b70.jpg not downloaded yet
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_f7392b2f3bc89319463f6a407783e2b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_f7392b2f3bc89319463f6a407783e2b8.jpg not downloaded yet
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_4d89f8be2f2213c70adbc387b954ef18.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4d89f8be2f2213c70adbc387b954ef18.jpg not downloaded yet
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_5a6fc35c2745140e5f3e7c8d9a0941e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5a6fc35c2745140e5f3e7c8d9a0941e0.jpg not downloaded yet
2026-03-30 11:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4ddff83d598e13faa782a61b20e3d429.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_5ded6f05ba95a505068a7d34b78e9ebd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5ded6f05ba95a505068a7d34b78e9ebd.jpg not downloaded yet
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc818a10>
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_e23af5a415084a7a6ad156e1aa7fae3c.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_e23af5a415084a7a6ad156e1aa7fae3c.jpg saved to cache
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b44cef7-adf2-5e16-99de-685b5d36a401
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc900f90>
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fd5%252Fd8d5a71356ece20d199f42debe568d02%252Fpa%252FML14183_09371058d112c101e2c6af853a3c8040.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_09371058d112c101e2c6af853a3c8040.jpg saved to cache
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b44cef7-adf2-5e16-99de-685b5d36a401
2026-03-30 11:40:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b44cef7-adf2-5e16-99de-685b5d36a401, skipping ID generation
2026-03-30 11:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b44cef7-adf2-5e16-99de-685b5d36a401 with scrape type 1
2026-03-30 11:40:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b44cef7-adf2-5e16-99de-685b5d36a401 sending to next pipeline
2026-03-30 11:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b44cef7-adf2-5e16-99de-685b5d36a401, identifier: ML14183
2026-03-30 11:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b44cef7-adf2-5e16-99de-685b5d36a401 with identifier: ML14183
2026-03-30 11:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b44cef7-adf2-5e16-99de-685b5d36a401 with identifier: ML14183
2026-03-30 11:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b44cef7-adf2-5e16-99de-685b5d36a401 with identifier: ML14183 to the API
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_09371058d112c101e2c6af853a3c8040.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:10:55Z',
 'fuel_type': 'diesel',
 'id': '1b44cef7-adf2-5e16-99de-685b5d36a401',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML14183',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 314886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_09371058d112c101e2c6af853a3c8040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_e23af5a415084a7a6ad156e1aa7fae3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_0ca6efc1eb01debb4b54477d0006c9ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_7a1f86b9a6b67e7513099ec47632573e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_58d1b710795acf20a7021dfff03a6f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b44cef7-adf2-5e16-99de-685b5d36a401/1b44cef7-adf2-5e16-99de-685b5d36a401_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/d5/d8d5a71356ece20d199f42debe568d02/pa/ML14183_75481fe6ca5543ff5e8898f46d0f95f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 3.0 D V6 Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2010}
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML14183%27 HTTP/1.1" 200 None
2026-03-30 11:40:52 [auto1.be] INFO: Saving data for ML14183: {'created_time': 1774870852.942811, 'last_price_update_time': 1774870852.942824, 'auction_closing_time': 1774969855.0}
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML14183') HTTP/1.1" 204 0
2026-03-30 11:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_498fa021d41c1a841d3563e2aa75c45f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4d89f8be2f2213c70adbc387b954ef18.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc74eb10>
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_4ddff83d598e13faa782a61b20e3d429.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4ddff83d598e13faa782a61b20e3d429.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5a6fc35c2745140e5f3e7c8d9a0941e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca55450>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_498fa021d41c1a841d3563e2aa75c45f.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_498fa021d41c1a841d3563e2aa75c45f.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc766450>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_4d89f8be2f2213c70adbc387b954ef18.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4d89f8be2f2213c70adbc387b954ef18.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5ded6f05ba95a505068a7d34b78e9ebd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71e090>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_5a6fc35c2745140e5f3e7c8d9a0941e0.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5a6fc35c2745140e5f3e7c8d9a0941e0.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_f7392b2f3bc89319463f6a407783e2b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9a5e10>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_5ded6f05ba95a505068a7d34b78e9ebd.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5ded6f05ba95a505068a7d34b78e9ebd.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71c290>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_f7392b2f3bc89319463f6a407783e2b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_f7392b2f3bc89319463f6a407783e2b8.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_2bfe7adaa98494a7a331e6ee16308b70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_de15daf6c8122981f3384a5a32dddda5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_26b8d91afac647337758b5e110b6394a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_3c9012c2d98875950704fa842a1b0ef7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca54cd0>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_2bfe7adaa98494a7a331e6ee16308b70.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_2bfe7adaa98494a7a331e6ee16308b70.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK26681> (referer: https://www.auto1.com/v1/car-details-view/AK26681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71e410>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_de15daf6c8122981f3384a5a32dddda5.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_de15daf6c8122981f3384a5a32dddda5.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc997110>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_26b8d91afac647337758b5e110b6394a.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_26b8d91afac647337758b5e110b6394a.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca41b90>
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F21%252Fe22126800ede67acc827297ad9f61f85%252Fpa%252FYW96684_3c9012c2d98875950704fa842a1b0ef7.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_3c9012c2d98875950704fa842a1b0ef7.jpg saved to cache
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d
2026-03-30 11:40:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d, skipping ID generation
2026-03-30 11:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d with scrape type 1
2026-03-30 11:40:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d sending to next pipeline
2026-03-30 11:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d, identifier: YW96684
2026-03-30 11:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d with identifier: YW96684
2026-03-30 11:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d with identifier: YW96684
2026-03-30 11:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d with identifier: YW96684 to the API
2026-03-30 11:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_3c9012c2d98875950704fa842a1b0ef7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 212,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:11:25Z',
 'fuel_type': 'petrol',
 'id': 'ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW96684',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 156058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_26b8d91afac647337758b5e110b6394a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_de15daf6c8122981f3384a5a32dddda5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_498fa021d41c1a841d3563e2aa75c45f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4ddff83d598e13faa782a61b20e3d429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_3c9012c2d98875950704fa842a1b0ef7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_2bfe7adaa98494a7a331e6ee16308b70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_f7392b2f3bc89319463f6a407783e2b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_4d89f8be2f2213c70adbc387b954ef18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5a6fc35c2745140e5f3e7c8d9a0941e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d/ac8416c6-35bc-5cf8-a400-ebf1d34c8c9d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/21/e22126800ede67acc827297ad9f61f85/pa/YW96684_5ded6f05ba95a505068a7d34b78e9ebd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96684%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [auto1.be] INFO: Saving data for YW96684: {'created_time': 1774870854.140255, 'last_price_update_time': 1774870854.140267, 'auction_closing_time': 1774969885.0}
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW96684') HTTP/1.1" 204 0
2026-03-30 11:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG04506> (referer: https://www.auto1.com/v1/car-details-view/PG04506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ca67dab-fd7e-5b32-b03a-c8c02900017a with identifier: AK26681
2026-03-30 11:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a with scrape type 1
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_9b885be3bbaddff7d1e66a6edf1c4852.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_9b885be3bbaddff7d1e66a6edf1c4852.jpg not downloaded yet
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_37d048a66390e6d042b377f3bf742048.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_37d048a66390e6d042b377f3bf742048.jpg not downloaded yet
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_dd73b51263d498c4dfa270539b5b8e3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_dd73b51263d498c4dfa270539b5b8e3e.jpg not downloaded yet
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_df1fc4ced4b01dee4aa516c5e5da4ecc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_df1fc4ced4b01dee4aa516c5e5da4ecc.jpg not downloaded yet
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_cbc2abf705a125b5d554235dab1aa118.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_cbc2abf705a125b5d554235dab1aa118.jpg not downloaded yet
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_ee3cbae37b34b8a3d486f2d404258711.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_ee3cbae37b34b8a3d486f2d404258711.jpg not downloaded yet
2026-03-30 11:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aab5c431-9e2b-5080-8804-32637b97eaa7 with identifier: PG04506
2026-03-30 11:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aab5c431-9e2b-5080-8804-32637b97eaa7 with scrape type 1
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item aab5c431-9e2b-5080-8804-32637b97eaa7
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fc0%252Ff7c0241478c63fb68b9867871bc9c8dd%252Fpa%252FPG04506_5be16ce5d647ea03da02228ecc5f6174.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_5be16ce5d647ea03da02228ecc5f6174.jpg already downloaded
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fc0%252Ff7c0241478c63fb68b9867871bc9c8dd%252Fpa%252FPG04506_64150a442abf8219341808d26bb84708.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_64150a442abf8219341808d26bb84708.jpg already downloaded
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fc0%252Ff7c0241478c63fb68b9867871bc9c8dd%252Fpa%252FPG04506_76e34ab6aedca76f585f3f2a0a175899.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_76e34ab6aedca76f585f3f2a0a175899.jpg already downloaded
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fc0%252Ff7c0241478c63fb68b9867871bc9c8dd%252Fpa%252FPG04506_b05a4b03f1eae41940c212f3b53c3d8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_b05a4b03f1eae41940c212f3b53c3d8c.jpg already downloaded
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fc0%252Ff7c0241478c63fb68b9867871bc9c8dd%252Fpa%252FPG04506_f7f2758c95b3ab47af1afba95df112e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_f7f2758c95b3ab47af1afba95df112e7.jpg already downloaded
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fc0%252Ff7c0241478c63fb68b9867871bc9c8dd%252Fpa%252FPG04506_e55f6e21664a3c5f8fce63b523f7bcd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_e55f6e21664a3c5f8fce63b523f7bcd1.jpg already downloaded
2026-03-30 11:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aab5c431-9e2b-5080-8804-32637b97eaa7, identifier: PG04506
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_a8352ffe1888fd04cb1e3d9e00252173.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_a8352ffe1888fd04cb1e3d9e00252173.jpg not downloaded yet
2026-03-30 11:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aab5c431-9e2b-5080-8804-32637b97eaa7 with identifier: PG04506
2026-03-30 11:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aab5c431-9e2b-5080-8804-32637b97eaa7 with identifier: PG04506
2026-03-30 11:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aab5c431-9e2b-5080-8804-32637b97eaa7 with identifier: PG04506 to the API
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PG04506>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:48:35Z',
 'fuel_type': 'petrol',
 'id': 'aab5c431-9e2b-5080-8804-32637b97eaa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG04506',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 160426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_5be16ce5d647ea03da02228ecc5f6174.jpg',
                'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_64150a442abf8219341808d26bb84708.jpg',
                'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_76e34ab6aedca76f585f3f2a0a175899.jpg',
                'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_b05a4b03f1eae41940c212f3b53c3d8c.jpg',
                'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_f7f2758c95b3ab47af1afba95df112e7.jpg',
                'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_e55f6e21664a3c5f8fce63b523f7bcd1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab5c431-9e2b-5080-8804-32637b97eaa7/aab5c431-9e2b-5080-8804-32637b97eaa7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_5be16ce5d647ea03da02228ecc5f6174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab5c431-9e2b-5080-8804-32637b97eaa7/aab5c431-9e2b-5080-8804-32637b97eaa7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_64150a442abf8219341808d26bb84708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab5c431-9e2b-5080-8804-32637b97eaa7/aab5c431-9e2b-5080-8804-32637b97eaa7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_76e34ab6aedca76f585f3f2a0a175899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab5c431-9e2b-5080-8804-32637b97eaa7/aab5c431-9e2b-5080-8804-32637b97eaa7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_b05a4b03f1eae41940c212f3b53c3d8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab5c431-9e2b-5080-8804-32637b97eaa7/aab5c431-9e2b-5080-8804-32637b97eaa7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_f7f2758c95b3ab47af1afba95df112e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab5c431-9e2b-5080-8804-32637b97eaa7/aab5c431-9e2b-5080-8804-32637b97eaa7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/c0/f7c0241478c63fb68b9867871bc9c8dd/pa/PG04506_e55f6e21664a3c5f8fce63b523f7bcd1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2012}
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG04506%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [auto1.be] INFO: Saving data for PG04506: {'created_time': 1774870854.897767, 'last_price_update_time': 1774870854.897777, 'auction_closing_time': 1774972115.0}
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PG04506') HTTP/1.1" 204 0
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_e9a58aa04487612af6e6bf31f06e628a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_e9a58aa04487612af6e6bf31f06e628a.jpg not downloaded yet
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_35740764e2af19ce76ab38221839bec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_35740764e2af19ce76ab38221839bec8.jpg not downloaded yet
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_73b6b33b8a06e71e197fba8ca5625326.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_73b6b33b8a06e71e197fba8ca5625326.jpg not downloaded yet
2026-03-30 11:40:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.174(s), this was the 1st time calling it.
2026-03-30 11:40:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.858212609419075 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH30880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_73b6b33b8a06e71e197fba8ca5625326.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86f610>
2026-03-30 11:41:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_73b6b33b8a06e71e197fba8ca5625326.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_73b6b33b8a06e71e197fba8ca5625326.jpg saved to cache
2026-03-30 11:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.665(s), this was the 1st time calling it.
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.597988483054587 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.678(s), this was the 1st time calling it.
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.615937080038782 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.929(s), this was the 1st time calling it.
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.249155059774019 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH57000> (referer: https://www.auto1.com/v1/car-details-view/HH57000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4320d38d-6b51-57d2-b40e-806dd9f75479 with identifier: HH57000
2026-03-30 11:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4320d38d-6b51-57d2-b40e-806dd9f75479 with scrape type 1
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4320d38d-6b51-57d2-b40e-806dd9f75479
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_929022ee68c2c480120965dde787c345.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_929022ee68c2c480120965dde787c345.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_5d53dd497c76d8c43bcbbb81fb77deff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_5d53dd497c76d8c43bcbbb81fb77deff.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_bf46e0357be1fb4e7bc369fba1282ca1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_bf46e0357be1fb4e7bc369fba1282ca1.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_571acfe208869e250d031f59411feec4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_571acfe208869e250d031f59411feec4.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_601de28725e0c743d13fc24ff485f7bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_601de28725e0c743d13fc24ff485f7bb.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_bf0ffa8c638079677f48eaf7ee9dc0d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_bf0ffa8c638079677f48eaf7ee9dc0d8.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_0f5e8e55d887c2ebf60b3d11091d8750.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_0f5e8e55d887c2ebf60b3d11091d8750.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_5e64b84c9adb9bf0ad11bab5d6c7a3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_5e64b84c9adb9bf0ad11bab5d6c7a3ac.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_f504849d4aa8b38f3e5c7a63f174acf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_f504849d4aa8b38f3e5c7a63f174acf2.jpg already downloaded
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fc6%252F37c6c829120bab647d665cb0ee37fd53%252Fpa%252FHH57000_a753ec16d51994beba6f27ee385607d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_a753ec16d51994beba6f27ee385607d0.jpg already downloaded
2026-03-30 11:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4320d38d-6b51-57d2-b40e-806dd9f75479, identifier: HH57000
2026-03-30 11:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4320d38d-6b51-57d2-b40e-806dd9f75479 with identifier: HH57000
2026-03-30 11:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4320d38d-6b51-57d2-b40e-806dd9f75479 with identifier: HH57000
2026-03-30 11:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4320d38d-6b51-57d2-b40e-806dd9f75479 with identifier: HH57000 to the API
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH57000>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-31T15:26:28Z',
 'fuel_type': 'petrol',
 'id': '4320d38d-6b51-57d2-b40e-806dd9f75479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH57000',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 111359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_929022ee68c2c480120965dde787c345.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_5d53dd497c76d8c43bcbbb81fb77deff.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_bf46e0357be1fb4e7bc369fba1282ca1.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_571acfe208869e250d031f59411feec4.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_601de28725e0c743d13fc24ff485f7bb.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_bf0ffa8c638079677f48eaf7ee9dc0d8.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_0f5e8e55d887c2ebf60b3d11091d8750.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_5e64b84c9adb9bf0ad11bab5d6c7a3ac.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_f504849d4aa8b38f3e5c7a63f174acf2.jpg',
                'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_a753ec16d51994beba6f27ee385607d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610873,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_929022ee68c2c480120965dde787c345.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_5d53dd497c76d8c43bcbbb81fb77deff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_bf46e0357be1fb4e7bc369fba1282ca1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_571acfe208869e250d031f59411feec4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_601de28725e0c743d13fc24ff485f7bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_bf0ffa8c638079677f48eaf7ee9dc0d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_0f5e8e55d887c2ebf60b3d11091d8750.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597427,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_5e64b84c9adb9bf0ad11bab5d6c7a3ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2477736,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_f504849d4aa8b38f3e5c7a63f174acf2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4320d38d-6b51-57d2-b40e-806dd9f75479/4320d38d-6b51-57d2-b40e-806dd9f75479_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/c6/37c6c829120bab647d665cb0ee37fd53/pa/HH57000_a753ec16d51994beba6f27ee385607d0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2013}
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH57000%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [auto1.be] INFO: Saving data for HH57000: {'created_time': 1774870863.280269, 'last_price_update_time': 1774870863.28028, 'auction_closing_time': 1774970788.0}
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH57000') HTTP/1.1" 204 0
2026-03-30 11:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_35740764e2af19ce76ab38221839bec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA85279> (referer: https://www.auto1.com/v1/car-details-view/MA85279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de879590>
2026-03-30 11:41:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_35740764e2af19ce76ab38221839bec8.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_35740764e2af19ce76ab38221839bec8.jpg saved to cache
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_a8352ffe1888fd04cb1e3d9e00252173.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5844ea2b-d262-5597-be4b-cd4a55b5d57f with identifier: MA85279
2026-03-30 11:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5844ea2b-d262-5597-be4b-cd4a55b5d57f with scrape type 1
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5844ea2b-d262-5597-be4b-cd4a55b5d57f
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_7af0dfc01e4beb86acbabb925b11ddf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_7af0dfc01e4beb86acbabb925b11ddf0.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_edb02227f31e01aeabfc6711adc21684.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_edb02227f31e01aeabfc6711adc21684.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_752c7d3e41e272421437ac9d1e6d779e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_752c7d3e41e272421437ac9d1e6d779e.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_8cf1127de8b660443a65a8a0f5c3e5b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_8cf1127de8b660443a65a8a0f5c3e5b1.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_ff11f2f709c168c3fbe7a99cf888c8e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ff11f2f709c168c3fbe7a99cf888c8e5.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_ddabafb0f08ed70bcd2e1131f62d6a1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ddabafb0f08ed70bcd2e1131f62d6a1d.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_ad7fe899cf72b3c0e7aab79d1d1a55c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ad7fe899cf72b3c0e7aab79d1d1a55c3.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_275531e523e18784d81b1e0d4918f272.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_275531e523e18784d81b1e0d4918f272.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_5a156e9ccb3eda142bed587545c42502.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_5a156e9ccb3eda142bed587545c42502.jpg already downloaded
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F01%252Fe4019dbfa7b8fd2acee227b99e643361%252Fpa%252FMA85279_3af325a065c8c8c29e25a2934261ac58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_3af325a065c8c8c29e25a2934261ac58.jpg already downloaded
2026-03-30 11:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5844ea2b-d262-5597-be4b-cd4a55b5d57f, identifier: MA85279
2026-03-30 11:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_e9a58aa04487612af6e6bf31f06e628a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5844ea2b-d262-5597-be4b-cd4a55b5d57f with identifier: MA85279
2026-03-30 11:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5844ea2b-d262-5597-be4b-cd4a55b5d57f with identifier: MA85279
2026-03-30 11:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5844ea2b-d262-5597-be4b-cd4a55b5d57f with identifier: MA85279 to the API
2026-03-30 11:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MA85279>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:19:50Z',
 'fuel_type': 'petrol',
 'id': '5844ea2b-d262-5597-be4b-cd4a55b5d57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA85279',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 66012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_7af0dfc01e4beb86acbabb925b11ddf0.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_edb02227f31e01aeabfc6711adc21684.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_752c7d3e41e272421437ac9d1e6d779e.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_8cf1127de8b660443a65a8a0f5c3e5b1.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ff11f2f709c168c3fbe7a99cf888c8e5.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ddabafb0f08ed70bcd2e1131f62d6a1d.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ad7fe899cf72b3c0e7aab79d1d1a55c3.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_275531e523e18784d81b1e0d4918f272.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_5a156e9ccb3eda142bed587545c42502.jpg',
                'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_3af325a065c8c8c29e25a2934261ac58.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_7af0dfc01e4beb86acbabb925b11ddf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_edb02227f31e01aeabfc6711adc21684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_752c7d3e41e272421437ac9d1e6d779e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_8cf1127de8b660443a65a8a0f5c3e5b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ff11f2f709c168c3fbe7a99cf888c8e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ddabafb0f08ed70bcd2e1131f62d6a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_ad7fe899cf72b3c0e7aab79d1d1a55c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_275531e523e18784d81b1e0d4918f272.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_5a156e9ccb3eda142bed587545c42502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5844ea2b-d262-5597-be4b-cd4a55b5d57f/5844ea2b-d262-5597-be4b-cd4a55b5d57f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/01/e4019dbfa7b8fd2acee227b99e643361/pa/MA85279_3af325a065c8c8c29e25a2934261ac58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA85279%27 HTTP/1.1" 200 None
2026-03-30 11:41:04 [auto1.be] INFO: Saving data for MA85279: {'created_time': 1774870864.195255, 'last_price_update_time': 1774870864.195271, 'auction_closing_time': 1774970390.0}
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA85279') HTTP/1.1" 204 0
2026-03-30 11:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_ee3cbae37b34b8a3d486f2d404258711.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb11590>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_a8352ffe1888fd04cb1e3d9e00252173.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_a8352ffe1888fd04cb1e3d9e00252173.jpg saved to cache
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8e8850>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_e9a58aa04487612af6e6bf31f06e628a.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_e9a58aa04487612af6e6bf31f06e628a.jpg saved to cache
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca42410>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_ee3cbae37b34b8a3d486f2d404258711.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_ee3cbae37b34b8a3d486f2d404258711.jpg saved to cache
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_cbc2abf705a125b5d554235dab1aa118.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994590>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_cbc2abf705a125b5d554235dab1aa118.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_cbc2abf705a125b5d554235dab1aa118.jpg saved to cache
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_df1fc4ced4b01dee4aa516c5e5da4ecc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_dd73b51263d498c4dfa270539b5b8e3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994350>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_df1fc4ced4b01dee4aa516c5e5da4ecc.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_df1fc4ced4b01dee4aa516c5e5da4ecc.jpg saved to cache
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_9b885be3bbaddff7d1e66a6edf1c4852.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d7510>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_dd73b51263d498c4dfa270539b5b8e3e.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_dd73b51263d498c4dfa270539b5b8e3e.jpg saved to cache
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc894950>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_9b885be3bbaddff7d1e66a6edf1c4852.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_9b885be3bbaddff7d1e66a6edf1c4852.jpg saved to cache
2026-03-30 11:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_37d048a66390e6d042b377f3bf742048.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca578d0>
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F1c%252Ff11cad119d5e2fc55b774f9f2ea0ede5%252Fpa%252FAK26681_37d048a66390e6d042b377f3bf742048.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_37d048a66390e6d042b377f3bf742048.jpg saved to cache
2026-03-30 11:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a
2026-03-30 11:41:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ca67dab-fd7e-5b32-b03a-c8c02900017a, skipping ID generation
2026-03-30 11:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a with scrape type 1
2026-03-30 11:41:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ca67dab-fd7e-5b32-b03a-c8c02900017a sending to next pipeline
2026-03-30 11:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ca67dab-fd7e-5b32-b03a-c8c02900017a, identifier: AK26681
2026-03-30 11:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ca67dab-fd7e-5b32-b03a-c8c02900017a with identifier: AK26681
2026-03-30 11:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:41:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 11:41:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ca67dab-fd7e-5b32-b03a-c8c02900017a with identifier: AK26681
2026-03-30 11:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ca67dab-fd7e-5b32-b03a-c8c02900017a with identifier: AK26681 to the API
2026-03-30 11:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_37d048a66390e6d042b377f3bf742048.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:30Z',
 'fuel_type': 'diesel',
 'id': '0ca67dab-fd7e-5b32-b03a-c8c02900017a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK26681',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 106900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_9b885be3bbaddff7d1e66a6edf1c4852.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_37d048a66390e6d042b377f3bf742048.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_dd73b51263d498c4dfa270539b5b8e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_df1fc4ced4b01dee4aa516c5e5da4ecc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_cbc2abf705a125b5d554235dab1aa118.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_ee3cbae37b34b8a3d486f2d404258711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_a8352ffe1888fd04cb1e3d9e00252173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_e9a58aa04487612af6e6bf31f06e628a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_35740764e2af19ce76ab38221839bec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca67dab-fd7e-5b32-b03a-c8c02900017a/0ca67dab-fd7e-5b32-b03a-c8c02900017a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/1c/f11cad119d5e2fc55b774f9f2ea0ede5/pa/AK26681_73b6b33b8a06e71e197fba8ca5625326.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 ed4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2017}
2026-03-30 11:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK26681%27 HTTP/1.1" 200 None
2026-03-30 11:41:06 [auto1.be] INFO: Saving data for AK26681: {'created_time': 1774870866.465875, 'last_price_update_time': 1774870866.465886, 'auction_closing_time': 1774969350.0}
2026-03-30 11:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK26681') HTTP/1.1" 204 0
2026-03-30 11:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:06 [scrapy.extensions.logstats] INFO: Crawled 51 pages (at 8 pages/min), scraped 41 items (at 7 items/min)
2026-03-30 11:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 11:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ66906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN23833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP52428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL68668> (referer: https://www.auto1.com/v1/car-details-view/JL68668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f94c15b-6ee0-55e5-a330-f1da95d1958f with identifier: JL68668
2026-03-30 11:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f with scrape type 1
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_c30b1a8cf18f167e593460cb06e08217.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c30b1a8cf18f167e593460cb06e08217.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_15640000b2f05eb36c382c925730001a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_15640000b2f05eb36c382c925730001a.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_73b19983c6d14711e13cd886f729f0bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_73b19983c6d14711e13cd886f729f0bd.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_21f2999afa71c00a4609ca60dfba1dd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_21f2999afa71c00a4609ca60dfba1dd7.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_5d1821221a059d6a2d8ebce1a877b405.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_5d1821221a059d6a2d8ebce1a877b405.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_cc930b105365968d4e1ed290b1706c94.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_cc930b105365968d4e1ed290b1706c94.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_b138bcf528c7733889dde10a4d149970.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_b138bcf528c7733889dde10a4d149970.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_0429bbc4628db0a3ebe6d465d53d7ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_0429bbc4628db0a3ebe6d465d53d7ff1.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_79d3102a951c5b7c2077a5b7801960c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_79d3102a951c5b7c2077a5b7801960c8.jpg not downloaded yet
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_c0062672b0bbd6292179a25bbce0abf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c0062672b0bbd6292179a25bbce0abf6.jpg not downloaded yet
2026-03-30 11:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF90944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c0062672b0bbd6292179a25bbce0abf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_79d3102a951c5b7c2077a5b7801960c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de88d850>
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_c0062672b0bbd6292179a25bbce0abf6.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c0062672b0bbd6292179a25bbce0abf6.jpg saved to cache
2026-03-30 11:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca92510>
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_79d3102a951c5b7c2077a5b7801960c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_79d3102a951c5b7c2077a5b7801960c8.jpg saved to cache
2026-03-30 11:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ18358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_0429bbc4628db0a3ebe6d465d53d7ff1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc74c310>
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_0429bbc4628db0a3ebe6d465d53d7ff1.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_0429bbc4628db0a3ebe6d465d53d7ff1.jpg saved to cache
2026-03-30 11:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_b138bcf528c7733889dde10a4d149970.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0ee90>
2026-03-30 11:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_b138bcf528c7733889dde10a4d149970.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_b138bcf528c7733889dde10a4d149970.jpg saved to cache
2026-03-30 11:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH30880> (referer: https://www.auto1.com/v1/car-details-view/ZH30880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6492e9b-631c-5fda-b69b-0912f0316587 with identifier: ZH30880
2026-03-30 11:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6492e9b-631c-5fda-b69b-0912f0316587 with scrape type 1
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6492e9b-631c-5fda-b69b-0912f0316587
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_b5f1a74e894552d58923ba334b8b319a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_b5f1a74e894552d58923ba334b8b319a.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_8d9147598dfb14f63d420f2fa5dc5c2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_8d9147598dfb14f63d420f2fa5dc5c2e.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_14500a0dd7e7cf7cf3148bb15cded2a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_14500a0dd7e7cf7cf3148bb15cded2a7.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_31f9a3d5bc30f5cbd9336454271dfbb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_31f9a3d5bc30f5cbd9336454271dfbb0.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_d3faa7591cc01eea1ce268e5b975586b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_d3faa7591cc01eea1ce268e5b975586b.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_006654134d588d0bd418780a3f178cfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_006654134d588d0bd418780a3f178cfb.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_adbc5458030adf176ab84060a3fce250.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_adbc5458030adf176ab84060a3fce250.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_0ba3b94e1120dbbf7383e95cf29b9505.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_0ba3b94e1120dbbf7383e95cf29b9505.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_db916f66754b30c1087027077de2c72d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_db916f66754b30c1087027077de2c72d.jpg already downloaded
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fa5%252Fe6a5266576a04fa9ac3c85623ae222d9%252Fpa%252FZH30880_9cf07f97350a4f3ed1b61a8c6855e2f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_9cf07f97350a4f3ed1b61a8c6855e2f9.jpg already downloaded
2026-03-30 11:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6492e9b-631c-5fda-b69b-0912f0316587, identifier: ZH30880
2026-03-30 11:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6492e9b-631c-5fda-b69b-0912f0316587 with identifier: ZH30880
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 11:41:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6492e9b-631c-5fda-b69b-0912f0316587 with identifier: ZH30880
2026-03-30 11:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6492e9b-631c-5fda-b69b-0912f0316587 with identifier: ZH30880 to the API
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZH30880>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:28:37Z',
 'fuel_type': 'diesel',
 'id': 'c6492e9b-631c-5fda-b69b-0912f0316587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH30880',
 'listing': 'auction',
 'location': 'Retie',
 'make': 'Renault',
 'model': 'Alaskan',
 'odometer': 220233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_b5f1a74e894552d58923ba334b8b319a.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_8d9147598dfb14f63d420f2fa5dc5c2e.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_14500a0dd7e7cf7cf3148bb15cded2a7.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_31f9a3d5bc30f5cbd9336454271dfbb0.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_d3faa7591cc01eea1ce268e5b975586b.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_006654134d588d0bd418780a3f178cfb.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_adbc5458030adf176ab84060a3fce250.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_0ba3b94e1120dbbf7383e95cf29b9505.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_db916f66754b30c1087027077de2c72d.jpg',
                'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_9cf07f97350a4f3ed1b61a8c6855e2f9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_b5f1a74e894552d58923ba334b8b319a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_8d9147598dfb14f63d420f2fa5dc5c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_14500a0dd7e7cf7cf3148bb15cded2a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_31f9a3d5bc30f5cbd9336454271dfbb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_d3faa7591cc01eea1ce268e5b975586b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_006654134d588d0bd418780a3f178cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_adbc5458030adf176ab84060a3fce250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_0ba3b94e1120dbbf7383e95cf29b9505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_db916f66754b30c1087027077de2c72d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6492e9b-631c-5fda-b69b-0912f0316587/c6492e9b-631c-5fda-b69b-0912f0316587_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/a5/e6a5266576a04fa9ac3c85623ae222d9/pa/ZH30880_9cf07f97350a4f3ed1b61a8c6855e2f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Alaskan 2.3 dCi Diesel Intens Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'Intens Double Cab 4x4',
 'year': 2019}
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH30880%27 HTTP/1.1" 200 None
2026-03-30 11:41:26 [auto1.be] INFO: Saving data for ZH30880: {'created_time': 1774870886.849679, 'last_price_update_time': 1774870886.849689, 'auction_closing_time': 1774970917.0}
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH30880') HTTP/1.1" 204 0
2026-03-30 11:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_cc930b105365968d4e1ed290b1706c94.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca40b50>
2026-03-30 11:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_cc930b105365968d4e1ed290b1706c94.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_cc930b105365968d4e1ed290b1706c94.jpg saved to cache
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_5d1821221a059d6a2d8ebce1a877b405.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc73dc90>
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_5d1821221a059d6a2d8ebce1a877b405.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_5d1821221a059d6a2d8ebce1a877b405.jpg saved to cache
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_21f2999afa71c00a4609ca60dfba1dd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc96a090>
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_21f2999afa71c00a4609ca60dfba1dd7.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_21f2999afa71c00a4609ca60dfba1dd7.jpg saved to cache
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_73b19983c6d14711e13cd886f729f0bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_15640000b2f05eb36c382c925730001a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c30b1a8cf18f167e593460cb06e08217.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0c6d0>
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_73b19983c6d14711e13cd886f729f0bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_73b19983c6d14711e13cd886f729f0bd.jpg saved to cache
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc968250>
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_15640000b2f05eb36c382c925730001a.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_15640000b2f05eb36c382c925730001a.jpg saved to cache
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc824090>
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F16%252Fd2163942088878db832de787d8c25181%252Fpa%252FJL68668_c30b1a8cf18f167e593460cb06e08217.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c30b1a8cf18f167e593460cb06e08217.jpg saved to cache
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f
2026-03-30 11:41:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f94c15b-6ee0-55e5-a330-f1da95d1958f, skipping ID generation
2026-03-30 11:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f with scrape type 1
2026-03-30 11:41:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f94c15b-6ee0-55e5-a330-f1da95d1958f sending to next pipeline
2026-03-30 11:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f94c15b-6ee0-55e5-a330-f1da95d1958f, identifier: JL68668
2026-03-30 11:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f94c15b-6ee0-55e5-a330-f1da95d1958f with identifier: JL68668
2026-03-30 11:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f94c15b-6ee0-55e5-a330-f1da95d1958f with identifier: JL68668
2026-03-30 11:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f94c15b-6ee0-55e5-a330-f1da95d1958f with identifier: JL68668 to the API
2026-03-30 11:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c30b1a8cf18f167e593460cb06e08217.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:59:11Z',
 'fuel_type': 'diesel',
 'id': '0f94c15b-6ee0-55e5-a330-f1da95d1958f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL68668',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 94064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c30b1a8cf18f167e593460cb06e08217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_15640000b2f05eb36c382c925730001a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_73b19983c6d14711e13cd886f729f0bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_21f2999afa71c00a4609ca60dfba1dd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_5d1821221a059d6a2d8ebce1a877b405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_cc930b105365968d4e1ed290b1706c94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_b138bcf528c7733889dde10a4d149970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_0429bbc4628db0a3ebe6d465d53d7ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_79d3102a951c5b7c2077a5b7801960c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f94c15b-6ee0-55e5-a330-f1da95d1958f/0f94c15b-6ee0-55e5-a330-f1da95d1958f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/16/d2163942088878db832de787d8c25181/pa/JL68668_c0062672b0bbd6292179a25bbce0abf6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2021}
2026-03-30 11:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL68668%27 HTTP/1.1" 200 None
2026-03-30 11:41:28 [auto1.be] INFO: Saving data for JL68668: {'created_time': 1774870888.124995, 'last_price_update_time': 1774870888.125006, 'auction_closing_time': 1774972751.0}
2026-03-30 11:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JL68668') HTTP/1.1" 204 0
2026-03-30 11:41:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.564(s), this was the 1st time calling it.
2026-03-30 11:41:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.129534854708788 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:33 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1758 | hits on page: 40
2026-03-30 11:41:33 [auto1.be] INFO: Found listing with ID: UW31030
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW31030%27 HTTP/1.1" 200 None
2026-03-30 11:41:33 [auto1.be] INFO: Scrape type for UW31030: 0
2026-03-30 11:41:33 [auto1.be] INFO: Found listing with ID: TG84892
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG84892%27 HTTP/1.1" 200 None
2026-03-30 11:41:33 [auto1.be] INFO: Scrape type for TG84892: 0
2026-03-30 11:41:33 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW35881%27 HTTP/1.1" 200 None
2026-03-30 11:41:33 [auto1.be] INFO: Scrape type for PW35881: 2
2026-03-30 11:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881
2026-03-30 11:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 441f1025-f35c-5d94-bc95-ce3433032384 with scrape type 2
2026-03-30 11:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 441f1025-f35c-5d94-bc95-ce3433032384 with scrape type 2
2026-03-30 11:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 441f1025-f35c-5d94-bc95-ce3433032384, identifier: PW35881
2026-03-30 11:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881
2026-03-30 11:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881
2026-03-30 11:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 441f1025-f35c-5d94-bc95-ce3433032384 with identifier: PW35881 to the API
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:09:07Z',
 'fuel_type': 'diesel',
 'id': '441f1025-f35c-5d94-bc95-ce3433032384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW35881',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 115085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-24',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 CDTI DPF Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW35881%27 HTTP/1.1" 200 None
2026-03-30 11:41:33 [auto1.be] INFO: Saving data for PW35881: {'auction_closing_time': 1774969747.0, 'created_time': 1774006559.949919, 'last_price_update_time': 1774870893.87776}
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PW35881') HTTP/1.1" 204 0
2026-03-30 11:41:33 [auto1.be] INFO: Found listing with ID: YD71561
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD71561%27 HTTP/1.1" 200 None
2026-03-30 11:41:33 [auto1.be] INFO: Scrape type for YD71561: 1
2026-03-30 11:41:33 [auto1.be] INFO: Found listing with ID: KP37607
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP37607%27 HTTP/1.1" 200 None
2026-03-30 11:41:33 [auto1.be] INFO: Scrape type for KP37607: 1
2026-03-30 11:41:33 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL16576%27 HTTP/1.1" 200 None
2026-03-30 11:41:33 [auto1.be] INFO: Scrape type for XL16576: 2
2026-03-30 11:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576
2026-03-30 11:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a3cb2bb-030f-5abf-9a87-f8788fde121f with scrape type 2
2026-03-30 11:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a3cb2bb-030f-5abf-9a87-f8788fde121f with scrape type 2
2026-03-30 11:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a3cb2bb-030f-5abf-9a87-f8788fde121f, identifier: XL16576
2026-03-30 11:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576
2026-03-30 11:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576
2026-03-30 11:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a3cb2bb-030f-5abf-9a87-f8788fde121f with identifier: XL16576 to the API
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:01:17Z',
 'fuel_type': 'diesel',
 'id': '9a3cb2bb-030f-5abf-9a87-f8788fde121f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL16576',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 180809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-30',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL16576%27 HTTP/1.1" 200 None
2026-03-30 11:41:34 [auto1.be] INFO: Saving data for XL16576: {'auction_closing_time': 1774969277.0, 'created_time': 1774001873.369565, 'last_price_update_time': 1774870894.389557}
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL16576') HTTP/1.1" 204 0
2026-03-30 11:41:34 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG24921%27 HTTP/1.1" 200 None
2026-03-30 11:41:34 [auto1.be] INFO: Scrape type for ZG24921: 2
2026-03-30 11:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921
2026-03-30 11:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7479c513-71f9-5ab6-9243-b27df08949cd with scrape type 2
2026-03-30 11:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7479c513-71f9-5ab6-9243-b27df08949cd with scrape type 2
2026-03-30 11:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7479c513-71f9-5ab6-9243-b27df08949cd, identifier: ZG24921
2026-03-30 11:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921
2026-03-30 11:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921
2026-03-30 11:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7479c513-71f9-5ab6-9243-b27df08949cd with identifier: ZG24921 to the API
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:09:36Z',
 'fuel_type': 'diesel',
 'id': '7479c513-71f9-5ab6-9243-b27df08949cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG24921',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 233764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-29',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG24921%27 HTTP/1.1" 200 None
2026-03-30 11:41:34 [auto1.be] INFO: Saving data for ZG24921: {'auction_closing_time': 1774969776.0, 'created_time': 1774001993.788666, 'last_price_update_time': 1774870894.838166}
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG24921') HTTP/1.1" 204 0
2026-03-30 11:41:34 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC38550%27 HTTP/1.1" 200 None
2026-03-30 11:41:34 [auto1.be] INFO: Scrape type for GC38550: 2
2026-03-30 11:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550
2026-03-30 11:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with scrape type 2
2026-03-30 11:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with scrape type 2
2026-03-30 11:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c45876a4-8ec2-5f4e-beca-ae6aa63777e2, identifier: GC38550
2026-03-30 11:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550
2026-03-30 11:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550
2026-03-30 11:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c45876a4-8ec2-5f4e-beca-ae6aa63777e2 with identifier: GC38550 to the API
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:35:08Z',
 'fuel_type': 'diesel',
 'id': 'c45876a4-8ec2-5f4e-beca-ae6aa63777e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC38550',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 188909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-10',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel CRDT Active',
 'transmission': 'manual',
 'trim': 'CRDT Active',
 'year': 2012}
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC38550%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Saving data for GC38550: {'auction_closing_time': 1774971308.0, 'created_time': 1774001927.409109, 'last_price_update_time': 1774870895.318215}
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC38550') HTTP/1.1" 204 0
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH87974%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for TH87974: 2
2026-03-30 11:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974
2026-03-30 11:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84ce392-7e68-596c-9551-1b9c05fe1a07 with scrape type 2
2026-03-30 11:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84ce392-7e68-596c-9551-1b9c05fe1a07 with scrape type 2
2026-03-30 11:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d84ce392-7e68-596c-9551-1b9c05fe1a07, identifier: TH87974
2026-03-30 11:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974
2026-03-30 11:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974
2026-03-30 11:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d84ce392-7e68-596c-9551-1b9c05fe1a07 with identifier: TH87974 to the API
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:44:49Z',
 'fuel_type': 'petrol',
 'id': 'd84ce392-7e68-596c-9551-1b9c05fe1a07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH87974',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH87974%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Saving data for TH87974: {'auction_closing_time': 1774971889.0, 'created_time': 1774006559.585328, 'last_price_update_time': 1774870895.776192}
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH87974') HTTP/1.1" 204 0
2026-03-30 11:41:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: XG99216
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: AB04209
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: UN98541
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN98541%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for UN98541: 1
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: GK69889
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: DZ46887
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ46887%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for DZ46887: 1
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: AP01808
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: HT85066
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT85066%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for HT85066: 1
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: DJ69749
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: TB60249
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: XX77269
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: GR73680
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR73680%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for GR73680: 1
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: XT71941
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT71941%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for XT71941: 1
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: EN31029
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: TU92557
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: LK77855
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: EY60903
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: TF54485
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: PH47402
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH47402%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for PH47402: 1
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: EC96968
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: SG30557
2026-03-30 11:41:35 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-30 11:41:35 [auto1.be] INFO: Scrape type for TH69152: 2
2026-03-30 11:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152
2026-03-30 11:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d445c775-1eca-591a-bf46-0db8e85dfef2 with scrape type 2
2026-03-30 11:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d445c775-1eca-591a-bf46-0db8e85dfef2 with scrape type 2
2026-03-30 11:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d445c775-1eca-591a-bf46-0db8e85dfef2, identifier: TH69152
2026-03-30 11:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152
2026-03-30 11:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152
2026-03-30 11:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d445c775-1eca-591a-bf46-0db8e85dfef2 with identifier: TH69152 to the API
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:54:59Z',
 'fuel_type': 'diesel',
 'id': 'd445c775-1eca-591a-bf46-0db8e85dfef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH69152',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 200485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2014}
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Saving data for TH69152: {'auction_closing_time': 1774972499.0, 'created_time': 1773226853.096859, 'last_price_update_time': 1774870896.380269}
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH69152') HTTP/1.1" 204 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: LM23300
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM23300%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for LM23300: 1
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: GM44657
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM44657%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for GM44657: 1
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: RF68102
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: TJ66513
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: JX51559
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX51559%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for JX51559: 1
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: BA58536
2026-03-30 11:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP73013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ54388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ66906> (referer: https://www.auto1.com/v1/car-details-view/LZ66906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0 with identifier: LZ66906
2026-03-30 11:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0 with scrape type 1
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_3070b5fd203537317873c759be44b91d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_3070b5fd203537317873c759be44b91d.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_662c93fb1163f216fd6b2ec7728e5690.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_662c93fb1163f216fd6b2ec7728e5690.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_5dfe036f7842390f1babb8fc39fec03a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_5dfe036f7842390f1babb8fc39fec03a.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_535a9ad2fcea4854d5ebdc45b83ccdf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_535a9ad2fcea4854d5ebdc45b83ccdf9.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_09c8c3fc896a495a2aaff2a5daf8f5e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_09c8c3fc896a495a2aaff2a5daf8f5e4.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_892bd5eb1f5fd56520325a89006b0710.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_892bd5eb1f5fd56520325a89006b0710.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_b2d7a7e0e1ccf736e84ce4a62278d3d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_b2d7a7e0e1ccf736e84ce4a62278d3d8.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_9fcdfc21b1ccfaedddd742bb29a69b58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_9fcdfc21b1ccfaedddd742bb29a69b58.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_2c56979205e7bb0d5a71ede2919de1ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_2c56979205e7bb0d5a71ede2919de1ae.jpg not downloaded yet
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_d6c7c0af17ce30cbe0d383754be07661.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_d6c7c0af17ce30cbe0d383754be07661.jpg not downloaded yet
2026-03-30 11:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ95998/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_d6c7c0af17ce30cbe0d383754be07661.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc882b10>
2026-03-30 11:41:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_d6c7c0af17ce30cbe0d383754be07661.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_d6c7c0af17ce30cbe0d383754be07661.jpg saved to cache
2026-03-30 11:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN56971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_2c56979205e7bb0d5a71ede2919de1ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc88a710>
2026-03-30 11:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_2c56979205e7bb0d5a71ede2919de1ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_2c56979205e7bb0d5a71ede2919de1ae.jpg saved to cache
2026-03-30 11:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN23833> (referer: https://www.auto1.com/v1/car-details-view/NN23833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e91b11-9a84-5ab3-8d11-d860894d428c with identifier: NN23833
2026-03-30 11:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e91b11-9a84-5ab3-8d11-d860894d428c with scrape type 1
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_ecf445e6b5ea455f66c81c025a057a93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_ecf445e6b5ea455f66c81c025a057a93.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_299fa6dd8ded180971c60ef62f58ba6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_299fa6dd8ded180971c60ef62f58ba6f.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_b5b0248dbbb89caf8471f2b95732de4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_b5b0248dbbb89caf8471f2b95732de4d.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_e07d49a202ff5f0f5378d83860954154.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_e07d49a202ff5f0f5378d83860954154.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_400bcbbb1849ba694686a28cb5f15e50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_400bcbbb1849ba694686a28cb5f15e50.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_68c75e35eb605622ae4d325ed81ad3f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_68c75e35eb605622ae4d325ed81ad3f3.jpg not downloaded yet
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_9fcdfc21b1ccfaedddd742bb29a69b58.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_47e5fa15943ddccf4d29bf9629181a8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_47e5fa15943ddccf4d29bf9629181a8e.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_412fc9d6a18923ac612f45bea6273a7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_412fc9d6a18923ac612f45bea6273a7f.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_881fecb64cf741eba32a1335aecac254.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_881fecb64cf741eba32a1335aecac254.jpg not downloaded yet
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_67c506f3f84ae0b038d102d7d3888285.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_67c506f3f84ae0b038d102d7d3888285.jpg not downloaded yet
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca53810>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_9fcdfc21b1ccfaedddd742bb29a69b58.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_9fcdfc21b1ccfaedddd742bb29a69b58.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_68c75e35eb605622ae4d325ed81ad3f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8704d0>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_68c75e35eb605622ae4d325ed81ad3f3.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_68c75e35eb605622ae4d325ed81ad3f3.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_67c506f3f84ae0b038d102d7d3888285.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de83e390>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_67c506f3f84ae0b038d102d7d3888285.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_67c506f3f84ae0b038d102d7d3888285.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_881fecb64cf741eba32a1335aecac254.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8c2050>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_881fecb64cf741eba32a1335aecac254.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_881fecb64cf741eba32a1335aecac254.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_412fc9d6a18923ac612f45bea6273a7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb12750>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_412fc9d6a18923ac612f45bea6273a7f.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_412fc9d6a18923ac612f45bea6273a7f.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_47e5fa15943ddccf4d29bf9629181a8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7bb350>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_47e5fa15943ddccf4d29bf9629181a8e.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_47e5fa15943ddccf4d29bf9629181a8e.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_400bcbbb1849ba694686a28cb5f15e50.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6eb790>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_400bcbbb1849ba694686a28cb5f15e50.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_400bcbbb1849ba694686a28cb5f15e50.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_e07d49a202ff5f0f5378d83860954154.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcaa2410>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_e07d49a202ff5f0f5378d83860954154.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_e07d49a202ff5f0f5378d83860954154.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_b5b0248dbbb89caf8471f2b95732de4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d810>
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_b5b0248dbbb89caf8471f2b95732de4d.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_b5b0248dbbb89caf8471f2b95732de4d.jpg saved to cache
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_299fa6dd8ded180971c60ef62f58ba6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_ecf445e6b5ea455f66c81c025a057a93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b8ad0>
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_299fa6dd8ded180971c60ef62f58ba6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_299fa6dd8ded180971c60ef62f58ba6f.jpg saved to cache
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d4e90>
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fdb%252F94db7e6d16e1f1c6180a225c52a67d1e%252Fpa%252FNN23833_ecf445e6b5ea455f66c81c025a057a93.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_ecf445e6b5ea455f66c81c025a057a93.jpg saved to cache
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59e91b11-9a84-5ab3-8d11-d860894d428c
2026-03-30 11:42:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59e91b11-9a84-5ab3-8d11-d860894d428c, skipping ID generation
2026-03-30 11:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e91b11-9a84-5ab3-8d11-d860894d428c with scrape type 1
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59e91b11-9a84-5ab3-8d11-d860894d428c sending to next pipeline
2026-03-30 11:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 59e91b11-9a84-5ab3-8d11-d860894d428c, identifier: NN23833
2026-03-30 11:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 59e91b11-9a84-5ab3-8d11-d860894d428c with identifier: NN23833
2026-03-30 11:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 59e91b11-9a84-5ab3-8d11-d860894d428c with identifier: NN23833
2026-03-30 11:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 59e91b11-9a84-5ab3-8d11-d860894d428c with identifier: NN23833 to the API
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_ecf445e6b5ea455f66c81c025a057a93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:07:03Z',
 'fuel_type': 'petrol',
 'id': '59e91b11-9a84-5ab3-8d11-d860894d428c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN23833',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 96907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_ecf445e6b5ea455f66c81c025a057a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_299fa6dd8ded180971c60ef62f58ba6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_b5b0248dbbb89caf8471f2b95732de4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_e07d49a202ff5f0f5378d83860954154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_400bcbbb1849ba694686a28cb5f15e50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_68c75e35eb605622ae4d325ed81ad3f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_47e5fa15943ddccf4d29bf9629181a8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_412fc9d6a18923ac612f45bea6273a7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_881fecb64cf741eba32a1335aecac254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e91b11-9a84-5ab3-8d11-d860894d428c/59e91b11-9a84-5ab3-8d11-d860894d428c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/db/94db7e6d16e1f1c6180a225c52a67d1e/pa/NN23833_67c506f3f84ae0b038d102d7d3888285.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2019}
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN23833%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [auto1.be] INFO: Saving data for NN23833: {'created_time': 1774870925.957807, 'last_price_update_time': 1774870925.95782, 'auction_closing_time': 1774969623.0}
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN23833') HTTP/1.1" 204 0
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_b2d7a7e0e1ccf736e84ce4a62278d3d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71edd0>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_b2d7a7e0e1ccf736e84ce4a62278d3d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_b2d7a7e0e1ccf736e84ce4a62278d3d8.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_892bd5eb1f5fd56520325a89006b0710.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de862290>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_892bd5eb1f5fd56520325a89006b0710.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_892bd5eb1f5fd56520325a89006b0710.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_09c8c3fc896a495a2aaff2a5daf8f5e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc846790>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_09c8c3fc896a495a2aaff2a5daf8f5e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_09c8c3fc896a495a2aaff2a5daf8f5e4.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_535a9ad2fcea4854d5ebdc45b83ccdf9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8c3410>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_535a9ad2fcea4854d5ebdc45b83ccdf9.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_535a9ad2fcea4854d5ebdc45b83ccdf9.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_5dfe036f7842390f1babb8fc39fec03a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [scrapy.extensions.logstats] INFO: Crawled 66 pages (at 15 pages/min), scraped 50 items (at 9 items/min)
2026-03-30 11:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc870dd0>
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_5dfe036f7842390f1babb8fc39fec03a.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_5dfe036f7842390f1babb8fc39fec03a.jpg saved to cache
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ18358> (referer: https://www.auto1.com/v1/car-details-view/HZ18358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_662c93fb1163f216fd6b2ec7728e5690.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_3070b5fd203537317873c759be44b91d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078ecd7d-0fcd-59ee-b493-d8691199502d with identifier: HZ18358
2026-03-30 11:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078ecd7d-0fcd-59ee-b493-d8691199502d with scrape type 1
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_ea3ce9c3cd77dca4ad739b3ce9d5877b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_ea3ce9c3cd77dca4ad739b3ce9d5877b.jpg not downloaded yet
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_8f8af4fb3fea16ff56269fceb8cf5a4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_8f8af4fb3fea16ff56269fceb8cf5a4b.jpg not downloaded yet
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_c114fc0ddfa7cd63dd0f6e4d10ae64f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_c114fc0ddfa7cd63dd0f6e4d10ae64f0.jpg not downloaded yet
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d010>
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_662c93fb1163f216fd6b2ec7728e5690.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_662c93fb1163f216fd6b2ec7728e5690.jpg saved to cache
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc817dd0>
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F41%252Fa441a3771db08f7a76e0056d72fe11cb%252Fpa%252FLZ66906_3070b5fd203537317873c759be44b91d.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_3070b5fd203537317873c759be44b91d.jpg saved to cache
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0
2026-03-30 11:42:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0, skipping ID generation
2026-03-30 11:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0 with scrape type 1
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0 sending to next pipeline
2026-03-30 11:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0, identifier: LZ66906
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_14dc28ba73981f2dc48741cdaf480200.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_14dc28ba73981f2dc48741cdaf480200.jpg not downloaded yet
2026-03-30 11:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0 with identifier: LZ66906
2026-03-30 11:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0 with identifier: LZ66906
2026-03-30 11:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1e155e4a-02f7-5ad7-85f0-e87a1e237dd0 with identifier: LZ66906 to the API
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_3070b5fd203537317873c759be44b91d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 129,
 'expiration_date': '2026-03-31T15:18:30Z',
 'fuel_type': 'petrol',
 'id': '1e155e4a-02f7-5ad7-85f0-e87a1e237dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ66906',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 90722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_3070b5fd203537317873c759be44b91d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_662c93fb1163f216fd6b2ec7728e5690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_5dfe036f7842390f1babb8fc39fec03a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_535a9ad2fcea4854d5ebdc45b83ccdf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_09c8c3fc896a495a2aaff2a5daf8f5e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_892bd5eb1f5fd56520325a89006b0710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_b2d7a7e0e1ccf736e84ce4a62278d3d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_9fcdfc21b1ccfaedddd742bb29a69b58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_2c56979205e7bb0d5a71ede2919de1ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e155e4a-02f7-5ad7-85f0-e87a1e237dd0/1e155e4a-02f7-5ad7-85f0-e87a1e237dd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/41/a441a3771db08f7a76e0056d72fe11cb/pa/LZ66906_d6c7c0af17ce30cbe0d383754be07661.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T2 Momentum Core 2WD',
 'transmission': 'manual',
 'trim': 'Momentum Core 2WD',
 'year': 2020}
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ66906%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [auto1.be] INFO: Saving data for LZ66906: {'created_time': 1774870927.833407, 'last_price_update_time': 1774870927.83342, 'auction_closing_time': 1774970310.0}
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ66906') HTTP/1.1" 204 0
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_cdb747471ea1fa1961ef6eb4e12b2ab5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_cdb747471ea1fa1961ef6eb4e12b2ab5.jpg not downloaded yet
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_b3ab194c0dcfd7d7466e2c19bf9e727f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_b3ab194c0dcfd7d7466e2c19bf9e727f.jpg not downloaded yet
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_179cf7176808fd679ce3c6050f8fd160.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_179cf7176808fd679ce3c6050f8fd160.jpg not downloaded yet
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_f0e8423505baaa80c467c7d385ca91bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_f0e8423505baaa80c467c7d385ca91bc.jpg not downloaded yet
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_a307b9f441d9570bd033bfc4686e86cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_a307b9f441d9570bd033bfc4686e86cd.jpg not downloaded yet
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_6500fcdcb4da65f481c22aa4c6565a75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_6500fcdcb4da65f481c22aa4c6565a75.jpg not downloaded yet
2026-03-30 11:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ37751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_6500fcdcb4da65f481c22aa4c6565a75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_a307b9f441d9570bd033bfc4686e86cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc830610>
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_6500fcdcb4da65f481c22aa4c6565a75.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_6500fcdcb4da65f481c22aa4c6565a75.jpg saved to cache
2026-03-30 11:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc76b190>
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_a307b9f441d9570bd033bfc4686e86cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_a307b9f441d9570bd033bfc4686e86cd.jpg saved to cache
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR86629/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_f0e8423505baaa80c467c7d385ca91bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_179cf7176808fd679ce3c6050f8fd160.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc715e90>
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_f0e8423505baaa80c467c7d385ca91bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_f0e8423505baaa80c467c7d385ca91bc.jpg saved to cache
2026-03-30 11:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc884190>
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_179cf7176808fd679ce3c6050f8fd160.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_179cf7176808fd679ce3c6050f8fd160.jpg saved to cache
2026-03-30 11:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC25453/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_b3ab194c0dcfd7d7466e2c19bf9e727f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_cdb747471ea1fa1961ef6eb4e12b2ab5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcab24d0>
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_b3ab194c0dcfd7d7466e2c19bf9e727f.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_b3ab194c0dcfd7d7466e2c19bf9e727f.jpg saved to cache
2026-03-30 11:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9745d0>
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_cdb747471ea1fa1961ef6eb4e12b2ab5.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_cdb747471ea1fa1961ef6eb4e12b2ab5.jpg saved to cache
2026-03-30 11:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX51559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_14dc28ba73981f2dc48741cdaf480200.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_c114fc0ddfa7cd63dd0f6e4d10ae64f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc854d90>
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_14dc28ba73981f2dc48741cdaf480200.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_14dc28ba73981f2dc48741cdaf480200.jpg saved to cache
2026-03-30 11:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc839210>
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_c114fc0ddfa7cd63dd0f6e4d10ae64f0.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_c114fc0ddfa7cd63dd0f6e4d10ae64f0.jpg saved to cache
2026-03-30 11:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ54388> (referer: https://www.auto1.com/v1/car-details-view/KJ54388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_8f8af4fb3fea16ff56269fceb8cf5a4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daa64619-6eaf-523c-831e-12e56cee74db with identifier: KJ54388
2026-03-30 11:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daa64619-6eaf-523c-831e-12e56cee74db with scrape type 1
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_74a025c7f496abab3f39b4369a8e0fe9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_74a025c7f496abab3f39b4369a8e0fe9.jpg not downloaded yet
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_a9dd304da203beb5c235076d5d8c31cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a9dd304da203beb5c235076d5d8c31cd.jpg not downloaded yet
2026-03-30 11:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_ea3ce9c3cd77dca4ad739b3ce9d5877b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_f0df5a93e106c8a681b7c0c5adb250ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_f0df5a93e106c8a681b7c0c5adb250ca.jpg not downloaded yet
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_a756a0e1ac31292edd448008f1caef09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a756a0e1ac31292edd448008f1caef09.jpg not downloaded yet
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_76185469f9eab035ff45533fd135d364.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_76185469f9eab035ff45533fd135d364.jpg not downloaded yet
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_3f540de7233fbf7cd0b745883e4bf109.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3f540de7233fbf7cd0b745883e4bf109.jpg not downloaded yet
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb10fd0>
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_8f8af4fb3fea16ff56269fceb8cf5a4b.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_8f8af4fb3fea16ff56269fceb8cf5a4b.jpg saved to cache
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_845447af26b147256519f327a6e312a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_845447af26b147256519f327a6e312a5.jpg not downloaded yet
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_9f626cb21b8276ae638bb8d4fe368bec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_9f626cb21b8276ae638bb8d4fe368bec.jpg not downloaded yet
2026-03-30 11:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a9dd304da203beb5c235076d5d8c31cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_4816333d511fa49130511e26bf8ea3a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_4816333d511fa49130511e26bf8ea3a1.jpg not downloaded yet
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6efb50>
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Ff6%252F84f6e4cd09f565bc54cf9de0bcb87cb8%252Fpa%252FHZ18358_ea3ce9c3cd77dca4ad739b3ce9d5877b.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_ea3ce9c3cd77dca4ad739b3ce9d5877b.jpg saved to cache
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 078ecd7d-0fcd-59ee-b493-d8691199502d
2026-03-30 11:42:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 078ecd7d-0fcd-59ee-b493-d8691199502d, skipping ID generation
2026-03-30 11:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078ecd7d-0fcd-59ee-b493-d8691199502d with scrape type 1
2026-03-30 11:42:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 078ecd7d-0fcd-59ee-b493-d8691199502d sending to next pipeline
2026-03-30 11:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 078ecd7d-0fcd-59ee-b493-d8691199502d, identifier: HZ18358
2026-03-30 11:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 078ecd7d-0fcd-59ee-b493-d8691199502d with identifier: HZ18358
2026-03-30 11:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 078ecd7d-0fcd-59ee-b493-d8691199502d with identifier: HZ18358
2026-03-30 11:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 078ecd7d-0fcd-59ee-b493-d8691199502d with identifier: HZ18358 to the API
2026-03-30 11:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_ea3ce9c3cd77dca4ad739b3ce9d5877b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 400,
 'expiration_date': '2026-03-31T15:00:52Z',
 'fuel_type': 'petrol',
 'id': '078ecd7d-0fcd-59ee-b493-d8691199502d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ18358',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 100123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_ea3ce9c3cd77dca4ad739b3ce9d5877b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_8f8af4fb3fea16ff56269fceb8cf5a4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_c114fc0ddfa7cd63dd0f6e4d10ae64f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_14dc28ba73981f2dc48741cdaf480200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_cdb747471ea1fa1961ef6eb4e12b2ab5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_b3ab194c0dcfd7d7466e2c19bf9e727f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_179cf7176808fd679ce3c6050f8fd160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_f0e8423505baaa80c467c7d385ca91bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_a307b9f441d9570bd033bfc4686e86cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078ecd7d-0fcd-59ee-b493-d8691199502d/078ecd7d-0fcd-59ee-b493-d8691199502d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/f6/84f6e4cd09f565bc54cf9de0bcb87cb8/pa/HZ18358_6500fcdcb4da65f481c22aa4c6565a75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ18358%27 HTTP/1.1" 200 None
2026-03-30 11:42:29 [auto1.be] INFO: Saving data for HZ18358: {'created_time': 1774870949.260347, 'last_price_update_time': 1774870949.26036, 'auction_closing_time': 1774969252.0}
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ18358') HTTP/1.1" 204 0
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_3700418da87f40aeaf2e3ce66b8066b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3700418da87f40aeaf2e3ce66b8066b7.jpg not downloaded yet
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81a9d0>
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_a9dd304da203beb5c235076d5d8c31cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a9dd304da203beb5c235076d5d8c31cd.jpg saved to cache
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_9f626cb21b8276ae638bb8d4fe368bec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8fc350>
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_9f626cb21b8276ae638bb8d4fe368bec.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_9f626cb21b8276ae638bb8d4fe368bec.jpg saved to cache
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3700418da87f40aeaf2e3ce66b8066b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc857150>
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_3700418da87f40aeaf2e3ce66b8066b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3700418da87f40aeaf2e3ce66b8066b7.jpg saved to cache
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_4816333d511fa49130511e26bf8ea3a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81a290>
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_4816333d511fa49130511e26bf8ea3a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_4816333d511fa49130511e26bf8ea3a1.jpg saved to cache
2026-03-30 11:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_845447af26b147256519f327a6e312a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb21b50>
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_845447af26b147256519f327a6e312a5.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_845447af26b147256519f327a6e312a5.jpg saved to cache
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3f540de7233fbf7cd0b745883e4bf109.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb13ad0>
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_3f540de7233fbf7cd0b745883e4bf109.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3f540de7233fbf7cd0b745883e4bf109.jpg saved to cache
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_76185469f9eab035ff45533fd135d364.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc855810>
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_76185469f9eab035ff45533fd135d364.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_76185469f9eab035ff45533fd135d364.jpg saved to cache
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a756a0e1ac31292edd448008f1caef09.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc768190>
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_a756a0e1ac31292edd448008f1caef09.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a756a0e1ac31292edd448008f1caef09.jpg saved to cache
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_f0df5a93e106c8a681b7c0c5adb250ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_74a025c7f496abab3f39b4369a8e0fe9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc702250>
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_f0df5a93e106c8a681b7c0c5adb250ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_f0df5a93e106c8a681b7c0c5adb250ca.jpg saved to cache
2026-03-30 11:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc74cf10>
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F74%252Fcf74a3d552828335549fba0a5fee2b10%252Fpa%252FKJ54388_74a025c7f496abab3f39b4369a8e0fe9.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_74a025c7f496abab3f39b4369a8e0fe9.jpg saved to cache
2026-03-30 11:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daa64619-6eaf-523c-831e-12e56cee74db
2026-03-30 11:42:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daa64619-6eaf-523c-831e-12e56cee74db, skipping ID generation
2026-03-30 11:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daa64619-6eaf-523c-831e-12e56cee74db with scrape type 1
2026-03-30 11:42:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daa64619-6eaf-523c-831e-12e56cee74db sending to next pipeline
2026-03-30 11:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: daa64619-6eaf-523c-831e-12e56cee74db, identifier: KJ54388
2026-03-30 11:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: daa64619-6eaf-523c-831e-12e56cee74db with identifier: KJ54388
2026-03-30 11:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: daa64619-6eaf-523c-831e-12e56cee74db with identifier: KJ54388
2026-03-30 11:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: daa64619-6eaf-523c-831e-12e56cee74db with identifier: KJ54388 to the API
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_74a025c7f496abab3f39b4369a8e0fe9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:16:27Z',
 'fuel_type': 'petrol',
 'id': 'daa64619-6eaf-523c-831e-12e56cee74db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ54388',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 118619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_74a025c7f496abab3f39b4369a8e0fe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a9dd304da203beb5c235076d5d8c31cd.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_f0df5a93e106c8a681b7c0c5adb250ca.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_a756a0e1ac31292edd448008f1caef09.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_76185469f9eab035ff45533fd135d364.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3f540de7233fbf7cd0b745883e4bf109.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_845447af26b147256519f327a6e312a5.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_9f626cb21b8276ae638bb8d4fe368bec.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_4816333d511fa49130511e26bf8ea3a1.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa64619-6eaf-523c-831e-12e56cee74db/daa64619-6eaf-523c-831e-12e56cee74db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/74/cf74a3d552828335549fba0a5fee2b10/pa/KJ54388_3700418da87f40aeaf2e3ce66b8066b7.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Grand Filou Cool',
 'transmission': 'manual',
 'trim': 'Grand Filou Cool',
 'year': 2003}
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KJ54388%27 HTTP/1.1" 200 None
2026-03-30 11:42:31 [auto1.be] INFO: Saving data for KJ54388: {'created_time': 1774870951.865901, 'last_price_update_time': 1774870951.865911, 'auction_closing_time': 1774970187.0}
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KJ54388') HTTP/1.1" 204 0
2026-03-30 11:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ95998> (referer: https://www.auto1.com/v1/car-details-view/CZ95998/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc164a6-a40f-575f-895d-facc315b1095 with identifier: CZ95998
2026-03-30 11:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc164a6-a40f-575f-895d-facc315b1095 with scrape type 1
2026-03-30 11:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_4f6132119ade2c8aab1581b6609cd438.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_4f6132119ade2c8aab1581b6609cd438.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_8a74f5daaa2afae10941857d7fd9594c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8a74f5daaa2afae10941857d7fd9594c.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_b8e46594df529dcb4c85ed6183bbaec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_b8e46594df529dcb4c85ed6183bbaec8.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_d9bd84d0af239d7ed9d71a0384a44cf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_d9bd84d0af239d7ed9d71a0384a44cf0.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_93ef5d490e2d5165f56f009bd00eae03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_93ef5d490e2d5165f56f009bd00eae03.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_89aac87003fab4d4d9d070294b0960d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_89aac87003fab4d4d9d070294b0960d5.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_eb5e547479e602951d42680e9902f182.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_eb5e547479e602951d42680e9902f182.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_5843e5e014cbdb84cfa1d627b491fd83.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_5843e5e014cbdb84cfa1d627b491fd83.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_8606ae9b3e00583be04c496210d97a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8606ae9b3e00583be04c496210d97a18.jpg not downloaded yet
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_2400c0cbc327a0504845ec6a2b827a0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_2400c0cbc327a0504845ec6a2b827a0e.jpg not downloaded yet
2026-03-30 11:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN56971> (referer: https://www.auto1.com/v1/car-details-view/FN56971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e171b9-f1fb-558e-8e30-dc32e876c628 with identifier: FN56971
2026-03-30 11:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e171b9-f1fb-558e-8e30-dc32e876c628 with scrape type 1
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_df5e1b49a40d1a7a8aa2440887723c52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_df5e1b49a40d1a7a8aa2440887723c52.jpg not downloaded yet
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_45d06f466b026b517e10bde37c0b85f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_45d06f466b026b517e10bde37c0b85f6.jpg not downloaded yet
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_9111491cad5bf5a25369813042c91313.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_9111491cad5bf5a25369813042c91313.jpg not downloaded yet
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_bc03fe235ba4058b424ab5577e0b43a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_bc03fe235ba4058b424ab5577e0b43a3.jpg not downloaded yet
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_57f9b4a4fb15ad79c451fb78e3776cf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_57f9b4a4fb15ad79c451fb78e3776cf6.jpg not downloaded yet
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_58617be3015cdcc7629600d220f84c89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_58617be3015cdcc7629600d220f84c89.jpg not downloaded yet
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_b97f456587fa51cb31b8d79d8320fc3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_b97f456587fa51cb31b8d79d8320fc3a.jpg not downloaded yet
2026-03-30 11:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_52106aa41a76f44b41700da74d2a6a6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_52106aa41a76f44b41700da74d2a6a6e.jpg not downloaded yet
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_2400c0cbc327a0504845ec6a2b827a0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_09dbde30c8982ec8ceae062b8e516432.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_09dbde30c8982ec8ceae062b8e516432.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_fe61b1ca7521afd35134161c559c2132.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_fe61b1ca7521afd35134161c559c2132.jpg not downloaded yet
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc825ed0>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_2400c0cbc327a0504845ec6a2b827a0e.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_2400c0cbc327a0504845ec6a2b827a0e.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_b97f456587fa51cb31b8d79d8320fc3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca47650>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_b97f456587fa51cb31b8d79d8320fc3a.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_b97f456587fa51cb31b8d79d8320fc3a.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_fe61b1ca7521afd35134161c559c2132.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6e82d0>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_fe61b1ca7521afd35134161c559c2132.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_fe61b1ca7521afd35134161c559c2132.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_09dbde30c8982ec8ceae062b8e516432.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc98bb90>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_09dbde30c8982ec8ceae062b8e516432.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_09dbde30c8982ec8ceae062b8e516432.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_52106aa41a76f44b41700da74d2a6a6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc76a810>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_52106aa41a76f44b41700da74d2a6a6e.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_52106aa41a76f44b41700da74d2a6a6e.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_58617be3015cdcc7629600d220f84c89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.659(s), this was the 1st time calling it.
2026-03-30 11:43:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.36210721830062 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb11310>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_58617be3015cdcc7629600d220f84c89.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_58617be3015cdcc7629600d220f84c89.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_57f9b4a4fb15ad79c451fb78e3776cf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc902810>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_57f9b4a4fb15ad79c451fb78e3776cf6.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_57f9b4a4fb15ad79c451fb78e3776cf6.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_bc03fe235ba4058b424ab5577e0b43a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8317d0>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_bc03fe235ba4058b424ab5577e0b43a3.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_bc03fe235ba4058b424ab5577e0b43a3.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_9111491cad5bf5a25369813042c91313.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0c910>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_9111491cad5bf5a25369813042c91313.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_9111491cad5bf5a25369813042c91313.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_45d06f466b026b517e10bde37c0b85f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_df5e1b49a40d1a7a8aa2440887723c52.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de7c9410>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_45d06f466b026b517e10bde37c0b85f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_45d06f466b026b517e10bde37c0b85f6.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6eda10>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5d%252Fd05da086b08039f739ca1d07e5650001%252Fpa%252FFN56971_df5e1b49a40d1a7a8aa2440887723c52.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_df5e1b49a40d1a7a8aa2440887723c52.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67e171b9-f1fb-558e-8e30-dc32e876c628
2026-03-30 11:43:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67e171b9-f1fb-558e-8e30-dc32e876c628, skipping ID generation
2026-03-30 11:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e171b9-f1fb-558e-8e30-dc32e876c628 with scrape type 1
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67e171b9-f1fb-558e-8e30-dc32e876c628 sending to next pipeline
2026-03-30 11:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 67e171b9-f1fb-558e-8e30-dc32e876c628, identifier: FN56971
2026-03-30 11:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 67e171b9-f1fb-558e-8e30-dc32e876c628 with identifier: FN56971
2026-03-30 11:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 67e171b9-f1fb-558e-8e30-dc32e876c628 with identifier: FN56971
2026-03-30 11:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 67e171b9-f1fb-558e-8e30-dc32e876c628 with identifier: FN56971 to the API
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_df5e1b49a40d1a7a8aa2440887723c52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.7L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:32:17Z',
 'fuel_type': 'diesel',
 'id': '67e171b9-f1fb-558e-8e30-dc32e876c628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN56971',
 'listing': 'auction',
 'location': 'BE, Wauthier-Braine',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 186290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_df5e1b49a40d1a7a8aa2440887723c52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_45d06f466b026b517e10bde37c0b85f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_9111491cad5bf5a25369813042c91313.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_bc03fe235ba4058b424ab5577e0b43a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_57f9b4a4fb15ad79c451fb78e3776cf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_58617be3015cdcc7629600d220f84c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_b97f456587fa51cb31b8d79d8320fc3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_52106aa41a76f44b41700da74d2a6a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_09dbde30c8982ec8ceae062b8e516432.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67e171b9-f1fb-558e-8e30-dc32e876c628/67e171b9-f1fb-558e-8e30-dc32e876c628_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/5d/d05da086b08039f739ca1d07e5650001/pa/FN56971_fe61b1ca7521afd35134161c559c2132.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.7 V6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN56971%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [auto1.be] INFO: Saving data for FN56971: {'created_time': 1774870985.737531, 'last_price_update_time': 1774870985.737543, 'auction_closing_time': 1774971137.0}
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN56971') HTTP/1.1" 204 0
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8606ae9b3e00583be04c496210d97a18.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc992a50>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_8606ae9b3e00583be04c496210d97a18.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8606ae9b3e00583be04c496210d97a18.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_5843e5e014cbdb84cfa1d627b491fd83.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8c2610>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_5843e5e014cbdb84cfa1d627b491fd83.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_5843e5e014cbdb84cfa1d627b491fd83.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_eb5e547479e602951d42680e9902f182.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc903b50>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_eb5e547479e602951d42680e9902f182.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_eb5e547479e602951d42680e9902f182.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_89aac87003fab4d4d9d070294b0960d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8c3290>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_89aac87003fab4d4d9d070294b0960d5.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_89aac87003fab4d4d9d070294b0960d5.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_93ef5d490e2d5165f56f009bd00eae03.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM44657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8ffe50>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_93ef5d490e2d5165f56f009bd00eae03.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_93ef5d490e2d5165f56f009bd00eae03.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_d9bd84d0af239d7ed9d71a0384a44cf0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc714f90>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_d9bd84d0af239d7ed9d71a0384a44cf0.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_d9bd84d0af239d7ed9d71a0384a44cf0.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_b8e46594df529dcb4c85ed6183bbaec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8a74f5daaa2afae10941857d7fd9594c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_4f6132119ade2c8aab1581b6609cd438.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.extensions.logstats] INFO: Crawled 77 pages (at 11 pages/min), scraped 54 items (at 4 items/min)
2026-03-30 11:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de861910>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_b8e46594df529dcb4c85ed6183bbaec8.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_b8e46594df529dcb4c85ed6183bbaec8.jpg saved to cache
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc827e90>
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_8a74f5daaa2afae10941857d7fd9594c.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8a74f5daaa2afae10941857d7fd9594c.jpg saved to cache
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0e1d0>
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fb2%252F5cb20e589011f2a7ea416f81a5d12408%252Fpa%252FCZ95998_4f6132119ade2c8aab1581b6609cd438.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_4f6132119ade2c8aab1581b6609cd438.jpg saved to cache
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bc164a6-a40f-575f-895d-facc315b1095
2026-03-30 11:43:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bc164a6-a40f-575f-895d-facc315b1095, skipping ID generation
2026-03-30 11:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc164a6-a40f-575f-895d-facc315b1095 with scrape type 1
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bc164a6-a40f-575f-895d-facc315b1095 sending to next pipeline
2026-03-30 11:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bc164a6-a40f-575f-895d-facc315b1095, identifier: CZ95998
2026-03-30 11:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bc164a6-a40f-575f-895d-facc315b1095 with identifier: CZ95998
2026-03-30 11:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bc164a6-a40f-575f-895d-facc315b1095 with identifier: CZ95998
2026-03-30 11:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bc164a6-a40f-575f-895d-facc315b1095 with identifier: CZ95998 to the API
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_4f6132119ade2c8aab1581b6609cd438.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 394,
 'expiration_date': '2026-03-31T15:18:34Z',
 'fuel_type': 'hybrid',
 'id': '2bc164a6-a40f-575f-895d-facc315b1095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ95998',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 107830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_4f6132119ade2c8aab1581b6609cd438.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8a74f5daaa2afae10941857d7fd9594c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_b8e46594df529dcb4c85ed6183bbaec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_d9bd84d0af239d7ed9d71a0384a44cf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_93ef5d490e2d5165f56f009bd00eae03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_89aac87003fab4d4d9d070294b0960d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_eb5e547479e602951d42680e9902f182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_5843e5e014cbdb84cfa1d627b491fd83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_8606ae9b3e00583be04c496210d97a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc164a6-a40f-575f-895d-facc315b1095/2bc164a6-a40f-575f-895d-facc315b1095_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/b2/5cb20e589011f2a7ea416f81a5d12408/pa/CZ95998_2400c0cbc327a0504845ec6a2b827a0e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ95998%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Saving data for CZ95998: {'created_time': 1774870987.696413, 'last_price_update_time': 1774870987.696422, 'auction_closing_time': 1774970314.0}
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CZ95998') HTTP/1.1" 204 0
2026-03-30 11:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM23300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ37751> (referer: https://www.auto1.com/v1/car-details-view/BZ37751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b504087d-399d-54d3-b78a-e52150b0a5cb with identifier: BZ37751
2026-03-30 11:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b504087d-399d-54d3-b78a-e52150b0a5cb with scrape type 1
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_9311a4bd8c0f266ea476f0bb2354dc04.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_9311a4bd8c0f266ea476f0bb2354dc04.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_8eb63ae0154937f4da4c83d8c843291a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8eb63ae0154937f4da4c83d8c843291a.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_742662f45bd0a1f3892dfa202db60822.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_742662f45bd0a1f3892dfa202db60822.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_63781f04ea28257c7162f3f25ef9ff5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_63781f04ea28257c7162f3f25ef9ff5c.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_8989710c0bc7e773e42bdaad6023bbd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8989710c0bc7e773e42bdaad6023bbd3.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_da9c8ff5799af264e0638aa7d81f459b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_da9c8ff5799af264e0638aa7d81f459b.jpg not downloaded yet
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_ecc3a2d20f69b2c51b30ac2f3ce6b4d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_ecc3a2d20f69b2c51b30ac2f3ce6b4d6.jpg not downloaded yet
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_b878afcab76e8c25c84a8a8baa0f64c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_b878afcab76e8c25c84a8a8baa0f64c7.jpg not downloaded yet
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_d595381d33cf4d431c9f01816472e08b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_d595381d33cf4d431c9f01816472e08b.jpg not downloaded yet
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_cd42ddc1baff73206194523ac9f46f37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_cd42ddc1baff73206194523ac9f46f37.jpg not downloaded yet
2026-03-30 11:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR86629> (referer: https://www.auto1.com/v1/car-details-view/CR86629/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f484f3f-685b-59f9-b179-eb26d276a951 with identifier: CR86629
2026-03-30 11:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f484f3f-685b-59f9-b179-eb26d276a951 with scrape type 1
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_00ff1e166054015f7fd809f89fce56ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_00ff1e166054015f7fd809f89fce56ee.jpg not downloaded yet
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_4034e0e6215250f94339ec0fad48d8ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_4034e0e6215250f94339ec0fad48d8ed.jpg not downloaded yet
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_fa0b3550e6986f370078ad2b38cf2cec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_fa0b3550e6986f370078ad2b38cf2cec.jpg not downloaded yet
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_c07ca32f94a6fdfcbaaf515e3096d9be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_c07ca32f94a6fdfcbaaf515e3096d9be.jpg not downloaded yet
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_7176a6740081d038f2edf1c5a78c1c3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_7176a6740081d038f2edf1c5a78c1c3d.jpg not downloaded yet
2026-03-30 11:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_cd42ddc1baff73206194523ac9f46f37.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_89bf3385d0a9f02a1b6847095f1e7fa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_89bf3385d0a9f02a1b6847095f1e7fa3.jpg not downloaded yet
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_b687a0e94cec444d95800fd0ac9f30ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_b687a0e94cec444d95800fd0ac9f30ce.jpg not downloaded yet
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_8b23067a1b89f9d4a7035c32d9218b87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_8b23067a1b89f9d4a7035c32d9218b87.jpg not downloaded yet
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_a8fa4877fca65be4bcaab51b4904d4ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_a8fa4877fca65be4bcaab51b4904d4ba.jpg not downloaded yet
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_9bdff7431f6780df53fa19b6868bc12d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_9bdff7431f6780df53fa19b6868bc12d.jpg not downloaded yet
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6ed410>
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_cd42ddc1baff73206194523ac9f46f37.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_cd42ddc1baff73206194523ac9f46f37.jpg saved to cache
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_7176a6740081d038f2edf1c5a78c1c3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb11790>
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_7176a6740081d038f2edf1c5a78c1c3d.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_7176a6740081d038f2edf1c5a78c1c3d.jpg saved to cache
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_9bdff7431f6780df53fa19b6868bc12d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8fe090>
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_9bdff7431f6780df53fa19b6868bc12d.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_9bdff7431f6780df53fa19b6868bc12d.jpg saved to cache
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_a8fa4877fca65be4bcaab51b4904d4ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb103d0>
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_a8fa4877fca65be4bcaab51b4904d4ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_a8fa4877fca65be4bcaab51b4904d4ba.jpg saved to cache
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_8b23067a1b89f9d4a7035c32d9218b87.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc989c50>
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_8b23067a1b89f9d4a7035c32d9218b87.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_8b23067a1b89f9d4a7035c32d9218b87.jpg saved to cache
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_b687a0e94cec444d95800fd0ac9f30ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0fc90>
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_b687a0e94cec444d95800fd0ac9f30ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_b687a0e94cec444d95800fd0ac9f30ce.jpg saved to cache
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_89bf3385d0a9f02a1b6847095f1e7fa3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6e8910>
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_89bf3385d0a9f02a1b6847095f1e7fa3.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_89bf3385d0a9f02a1b6847095f1e7fa3.jpg saved to cache
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_c07ca32f94a6fdfcbaaf515e3096d9be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d050>
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_c07ca32f94a6fdfcbaaf515e3096d9be.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_c07ca32f94a6fdfcbaaf515e3096d9be.jpg saved to cache
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_fa0b3550e6986f370078ad2b38cf2cec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc920550>
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_fa0b3550e6986f370078ad2b38cf2cec.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_fa0b3550e6986f370078ad2b38cf2cec.jpg saved to cache
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_4034e0e6215250f94339ec0fad48d8ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_00ff1e166054015f7fd809f89fce56ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca86ed0>
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_4034e0e6215250f94339ec0fad48d8ed.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_4034e0e6215250f94339ec0fad48d8ed.jpg saved to cache
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc74d050>
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7e33159ddc6f128815ddc7aa30b5c%252Fpa%252FCR86629_00ff1e166054015f7fd809f89fce56ee.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_00ff1e166054015f7fd809f89fce56ee.jpg saved to cache
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f484f3f-685b-59f9-b179-eb26d276a951
2026-03-30 11:43:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f484f3f-685b-59f9-b179-eb26d276a951, skipping ID generation
2026-03-30 11:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f484f3f-685b-59f9-b179-eb26d276a951 with scrape type 1
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f484f3f-685b-59f9-b179-eb26d276a951 sending to next pipeline
2026-03-30 11:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f484f3f-685b-59f9-b179-eb26d276a951, identifier: CR86629
2026-03-30 11:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f484f3f-685b-59f9-b179-eb26d276a951 with identifier: CR86629
2026-03-30 11:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f484f3f-685b-59f9-b179-eb26d276a951 with identifier: CR86629
2026-03-30 11:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f484f3f-685b-59f9-b179-eb26d276a951 with identifier: CR86629 to the API
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_00ff1e166054015f7fd809f89fce56ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:44:01Z',
 'fuel_type': 'diesel',
 'id': '8f484f3f-685b-59f9-b179-eb26d276a951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR86629',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 129259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_00ff1e166054015f7fd809f89fce56ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_4034e0e6215250f94339ec0fad48d8ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_fa0b3550e6986f370078ad2b38cf2cec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_c07ca32f94a6fdfcbaaf515e3096d9be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_7176a6740081d038f2edf1c5a78c1c3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_89bf3385d0a9f02a1b6847095f1e7fa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_b687a0e94cec444d95800fd0ac9f30ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_8b23067a1b89f9d4a7035c32d9218b87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_a8fa4877fca65be4bcaab51b4904d4ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f484f3f-685b-59f9-b179-eb26d276a951/8f484f3f-685b-59f9-b179-eb26d276a951_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7e33159ddc6f128815ddc7aa30b5c/pa/CR86629_9bdff7431f6780df53fa19b6868bc12d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR86629%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [auto1.be] INFO: Saving data for CR86629: {'created_time': 1774870992.530027, 'last_price_update_time': 1774870992.530037, 'auction_closing_time': 1774971841.0}
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CR86629') HTTP/1.1" 204 0
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_d595381d33cf4d431c9f01816472e08b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU90120> (referer: https://www.auto1.com/v1/car-details-view/FU90120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC25453> (referer: https://www.auto1.com/v1/car-details-view/RC25453/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca86ad0>
2026-03-30 11:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_d595381d33cf4d431c9f01816472e08b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_d595381d33cf4d431c9f01816472e08b.jpg saved to cache
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebf25cd-5b69-50e5-aa51-fb54f387d36a with identifier: FU90120
2026-03-30 11:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebf25cd-5b69-50e5-aa51-fb54f387d36a with scrape type 1
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_d7186c5f7dca5a01954a8da3eb4669fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_d7186c5f7dca5a01954a8da3eb4669fc.jpg not downloaded yet
2026-03-30 11:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02c9ef8-833c-5330-9311-4b19b11aca92 with identifier: RC25453
2026-03-30 11:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02c9ef8-833c-5330-9311-4b19b11aca92 with scrape type 1
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_b3e8185993cf780b6cf98ab498013c34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b3e8185993cf780b6cf98ab498013c34.jpg not downloaded yet
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_ecc3a2d20f69b2c51b30ac2f3ce6b4d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_b878afcab76e8c25c84a8a8baa0f64c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_b5f8f848a2b6516d7750379fd6e2f46b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_b5f8f848a2b6516d7750379fd6e2f46b.jpg not downloaded yet
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_01f707383b6be28157566a1ceb18c0a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_01f707383b6be28157566a1ceb18c0a9.jpg not downloaded yet
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_04901687527b651d22a82b8e1659be08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_04901687527b651d22a82b8e1659be08.jpg not downloaded yet
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_25b341a7b9d8b5ec30e28fa48c2d3836.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_25b341a7b9d8b5ec30e28fa48c2d3836.jpg not downloaded yet
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_da9c8ff5799af264e0638aa7d81f459b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_bd29ac1bc79a53b283004c481baa28da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_bd29ac1bc79a53b283004c481baa28da.jpg not downloaded yet
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_7a31cd107cb4465a442e1eb833cc47e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_7a31cd107cb4465a442e1eb833cc47e3.jpg not downloaded yet
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_5bc6cb5502a2cf17148cf0efa725b14f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5bc6cb5502a2cf17148cf0efa725b14f.jpg not downloaded yet
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_0115ae9430b7569a9192f3862f4aaace.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_0115ae9430b7569a9192f3862f4aaace.jpg not downloaded yet
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b3e8185993cf780b6cf98ab498013c34.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_d7186c5f7dca5a01954a8da3eb4669fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_6251b9a1662585c80430ea03ee9f4d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_6251b9a1662585c80430ea03ee9f4d44.jpg not downloaded yet
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_e34999eca9c0593c5e399014dc7d1768.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_e34999eca9c0593c5e399014dc7d1768.jpg not downloaded yet
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc74f2d0>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_ecc3a2d20f69b2c51b30ac2f3ce6b4d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_ecc3a2d20f69b2c51b30ac2f3ce6b4d6.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc77c450>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_b878afcab76e8c25c84a8a8baa0f64c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_b878afcab76e8c25c84a8a8baa0f64c7.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_26c909b29e39bc1a3bcb969edbffa642.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_26c909b29e39bc1a3bcb969edbffa642.jpg not downloaded yet
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_5688e9f20dbd0b43a35cb9df3d5647b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_5688e9f20dbd0b43a35cb9df3d5647b0.jpg not downloaded yet
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_25b341a7b9d8b5ec30e28fa48c2d3836.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc789050>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_da9c8ff5799af264e0638aa7d81f459b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_da9c8ff5799af264e0638aa7d81f459b.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc938c10>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_b3e8185993cf780b6cf98ab498013c34.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b3e8185993cf780b6cf98ab498013c34.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b3f50>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_d7186c5f7dca5a01954a8da3eb4669fc.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_d7186c5f7dca5a01954a8da3eb4669fc.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_65abaf765e92ca34bc9387cb9f61effa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_65abaf765e92ca34bc9387cb9f61effa.jpg not downloaded yet
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_b182d8dd0e16b2867bc7d6b2d11c7f0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b182d8dd0e16b2867bc7d6b2d11c7f0c.jpg not downloaded yet
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_5235866781b1f0084b944c09372ddb46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5235866781b1f0084b944c09372ddb46.jpg not downloaded yet
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_466210758fb00462504108570b4b0b20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_466210758fb00462504108570b4b0b20.jpg not downloaded yet
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c4f90>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_25b341a7b9d8b5ec30e28fa48c2d3836.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_25b341a7b9d8b5ec30e28fa48c2d3836.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_0115ae9430b7569a9192f3862f4aaace.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5bc6cb5502a2cf17148cf0efa725b14f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_8e7f2d0d30abbdaa48ad28bd509a79cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_8e7f2d0d30abbdaa48ad28bd509a79cd.jpg not downloaded yet
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_2b21f2391477ef3626016bb748d52b72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_2b21f2391477ef3626016bb748d52b72.jpg not downloaded yet
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d8a10>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_0115ae9430b7569a9192f3862f4aaace.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_0115ae9430b7569a9192f3862f4aaace.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc73de50>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_5bc6cb5502a2cf17148cf0efa725b14f.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5bc6cb5502a2cf17148cf0efa725b14f.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_e34999eca9c0593c5e399014dc7d1768.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5235866781b1f0084b944c09372ddb46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_466210758fb00462504108570b4b0b20.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_2b21f2391477ef3626016bb748d52b72.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b182d8dd0e16b2867bc7d6b2d11c7f0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dd6e0750>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_e34999eca9c0593c5e399014dc7d1768.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_e34999eca9c0593c5e399014dc7d1768.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f4790>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_5235866781b1f0084b944c09372ddb46.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5235866781b1f0084b944c09372ddb46.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5d34d0>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_466210758fb00462504108570b4b0b20.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_466210758fb00462504108570b4b0b20.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7acb10>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_2b21f2391477ef3626016bb748d52b72.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_2b21f2391477ef3626016bb748d52b72.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_8e7f2d0d30abbdaa48ad28bd509a79cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_65abaf765e92ca34bc9387cb9f61effa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc79e650>
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_b182d8dd0e16b2867bc7d6b2d11c7f0c.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b182d8dd0e16b2867bc7d6b2d11c7f0c.jpg saved to cache
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_5688e9f20dbd0b43a35cb9df3d5647b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f6150>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_8e7f2d0d30abbdaa48ad28bd509a79cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_8e7f2d0d30abbdaa48ad28bd509a79cd.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca52e50>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_65abaf765e92ca34bc9387cb9f61effa.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_65abaf765e92ca34bc9387cb9f61effa.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca453d0>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_5688e9f20dbd0b43a35cb9df3d5647b0.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_5688e9f20dbd0b43a35cb9df3d5647b0.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_6251b9a1662585c80430ea03ee9f4d44.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_7a31cd107cb4465a442e1eb833cc47e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_26c909b29e39bc1a3bcb969edbffa642.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca52150>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_6251b9a1662585c80430ea03ee9f4d44.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_6251b9a1662585c80430ea03ee9f4d44.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6fba90>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_7a31cd107cb4465a442e1eb833cc47e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_7a31cd107cb4465a442e1eb833cc47e3.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_01f707383b6be28157566a1ceb18c0a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_04901687527b651d22a82b8e1659be08.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_bd29ac1bc79a53b283004c481baa28da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c3990>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_26c909b29e39bc1a3bcb969edbffa642.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_26c909b29e39bc1a3bcb969edbffa642.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_63781f04ea28257c7162f3f25ef9ff5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75e550>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F32%252Fcb320344a7fac750e695c349a4305611%252Fpa%252FRC25453_01f707383b6be28157566a1ceb18c0a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_01f707383b6be28157566a1ceb18c0a9.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c02c9ef8-833c-5330-9311-4b19b11aca92
2026-03-30 11:43:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c02c9ef8-833c-5330-9311-4b19b11aca92, skipping ID generation
2026-03-30 11:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02c9ef8-833c-5330-9311-4b19b11aca92 with scrape type 1
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c02c9ef8-833c-5330-9311-4b19b11aca92 sending to next pipeline
2026-03-30 11:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c02c9ef8-833c-5330-9311-4b19b11aca92, identifier: RC25453
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73df031250>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_04901687527b651d22a82b8e1659be08.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_04901687527b651d22a82b8e1659be08.jpg saved to cache
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c57d0>
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_bd29ac1bc79a53b283004c481baa28da.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_bd29ac1bc79a53b283004c481baa28da.jpg saved to cache
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c02c9ef8-833c-5330-9311-4b19b11aca92 with identifier: RC25453
2026-03-30 11:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c02c9ef8-833c-5330-9311-4b19b11aca92 with identifier: RC25453
2026-03-30 11:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c02c9ef8-833c-5330-9311-4b19b11aca92 with identifier: RC25453 to the API
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_01f707383b6be28157566a1ceb18c0a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:59:33Z',
 'fuel_type': 'petrol',
 'id': 'c02c9ef8-833c-5330-9311-4b19b11aca92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC25453',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 220910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b3e8185993cf780b6cf98ab498013c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_01f707383b6be28157566a1ceb18c0a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_25b341a7b9d8b5ec30e28fa48c2d3836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_7a31cd107cb4465a442e1eb833cc47e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_0115ae9430b7569a9192f3862f4aaace.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_e34999eca9c0593c5e399014dc7d1768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_5688e9f20dbd0b43a35cb9df3d5647b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_b182d8dd0e16b2867bc7d6b2d11c7f0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_466210758fb00462504108570b4b0b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c02c9ef8-833c-5330-9311-4b19b11aca92/c02c9ef8-833c-5330-9311-4b19b11aca92_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/32/cb320344a7fac750e695c349a4305611/pa/RC25453_2b21f2391477ef3626016bb748d52b72.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25453%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Saving data for RC25453: {'created_time': 1774870995.488404, 'last_price_update_time': 1774870995.488414, 'auction_closing_time': 1774972773.0}
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC25453') HTTP/1.1" 204 0
2026-03-30 11:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_742662f45bd0a1f3892dfa202db60822.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_b5f8f848a2b6516d7750379fd6e2f46b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8989710c0bc7e773e42bdaad6023bbd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca1bad0>
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_63781f04ea28257c7162f3f25ef9ff5c.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_63781f04ea28257c7162f3f25ef9ff5c.jpg saved to cache
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc844a90>
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_742662f45bd0a1f3892dfa202db60822.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_742662f45bd0a1f3892dfa202db60822.jpg saved to cache
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7aa990>
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F63%252Fa46321c1064a9e495f8ceacc4274f858%252Fpa%252FFU90120_b5f8f848a2b6516d7750379fd6e2f46b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_b5f8f848a2b6516d7750379fd6e2f46b.jpg saved to cache
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eebf25cd-5b69-50e5-aa51-fb54f387d36a
2026-03-30 11:43:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eebf25cd-5b69-50e5-aa51-fb54f387d36a, skipping ID generation
2026-03-30 11:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebf25cd-5b69-50e5-aa51-fb54f387d36a with scrape type 1
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eebf25cd-5b69-50e5-aa51-fb54f387d36a sending to next pipeline
2026-03-30 11:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eebf25cd-5b69-50e5-aa51-fb54f387d36a, identifier: FU90120
2026-03-30 11:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eebf25cd-5b69-50e5-aa51-fb54f387d36a with identifier: FU90120
2026-03-30 11:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eebf25cd-5b69-50e5-aa51-fb54f387d36a with identifier: FU90120
2026-03-30 11:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eebf25cd-5b69-50e5-aa51-fb54f387d36a with identifier: FU90120 to the API
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_b5f8f848a2b6516d7750379fd6e2f46b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:46:14Z',
 'fuel_type': 'petrol',
 'id': 'eebf25cd-5b69-50e5-aa51-fb54f387d36a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU90120',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 83775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_d7186c5f7dca5a01954a8da3eb4669fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_b5f8f848a2b6516d7750379fd6e2f46b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_04901687527b651d22a82b8e1659be08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_bd29ac1bc79a53b283004c481baa28da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5bc6cb5502a2cf17148cf0efa725b14f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_6251b9a1662585c80430ea03ee9f4d44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_26c909b29e39bc1a3bcb969edbffa642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_65abaf765e92ca34bc9387cb9f61effa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_5235866781b1f0084b944c09372ddb46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebf25cd-5b69-50e5-aa51-fb54f387d36a/eebf25cd-5b69-50e5-aa51-fb54f387d36a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/63/a46321c1064a9e495f8ceacc4274f858/pa/FU90120_8e7f2d0d30abbdaa48ad28bd509a79cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU90120%27 HTTP/1.1" 200 None
2026-03-30 11:43:16 [auto1.be] INFO: Saving data for FU90120: {'created_time': 1774870996.581756, 'last_price_update_time': 1774870996.581768, 'auction_closing_time': 1774971974.0}
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FU90120') HTTP/1.1" 204 0
2026-03-30 11:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_9311a4bd8c0f266ea476f0bb2354dc04.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8eb63ae0154937f4da4c83d8c843291a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dee803d0>
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_8989710c0bc7e773e42bdaad6023bbd3.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8989710c0bc7e773e42bdaad6023bbd3.jpg saved to cache
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deae5e50>
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_9311a4bd8c0f266ea476f0bb2354dc04.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_9311a4bd8c0f266ea476f0bb2354dc04.jpg saved to cache
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73eafe6150>
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Feb%252F98eb3d225c67488ec94d01a19a408143%252Fpa%252FBZ37751_8eb63ae0154937f4da4c83d8c843291a.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8eb63ae0154937f4da4c83d8c843291a.jpg saved to cache
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b504087d-399d-54d3-b78a-e52150b0a5cb
2026-03-30 11:43:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b504087d-399d-54d3-b78a-e52150b0a5cb, skipping ID generation
2026-03-30 11:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b504087d-399d-54d3-b78a-e52150b0a5cb with scrape type 1
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b504087d-399d-54d3-b78a-e52150b0a5cb sending to next pipeline
2026-03-30 11:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b504087d-399d-54d3-b78a-e52150b0a5cb, identifier: BZ37751
2026-03-30 11:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b504087d-399d-54d3-b78a-e52150b0a5cb with identifier: BZ37751
2026-03-30 11:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b504087d-399d-54d3-b78a-e52150b0a5cb with identifier: BZ37751
2026-03-30 11:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b504087d-399d-54d3-b78a-e52150b0a5cb with identifier: BZ37751 to the API
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8eb63ae0154937f4da4c83d8c843291a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:38:49Z',
 'fuel_type': 'diesel',
 'id': 'b504087d-399d-54d3-b78a-e52150b0a5cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ37751',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 150702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_9311a4bd8c0f266ea476f0bb2354dc04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8eb63ae0154937f4da4c83d8c843291a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_742662f45bd0a1f3892dfa202db60822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_63781f04ea28257c7162f3f25ef9ff5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_8989710c0bc7e773e42bdaad6023bbd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_da9c8ff5799af264e0638aa7d81f459b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_ecc3a2d20f69b2c51b30ac2f3ce6b4d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_b878afcab76e8c25c84a8a8baa0f64c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_d595381d33cf4d431c9f01816472e08b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b504087d-399d-54d3-b78a-e52150b0a5cb/b504087d-399d-54d3-b78a-e52150b0a5cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/eb/98eb3d225c67488ec94d01a19a408143/pa/BZ37751_cd42ddc1baff73206194523ac9f46f37.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ37751%27 HTTP/1.1" 200 None
2026-03-30 11:43:17 [auto1.be] INFO: Saving data for BZ37751: {'created_time': 1774870997.388998, 'last_price_update_time': 1774870997.38901, 'auction_closing_time': 1774971529.0}
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ37751') HTTP/1.1" 204 0
2026-03-30 11:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH47402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT71941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX51559> (referer: https://www.auto1.com/v1/car-details-view/JX51559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82472134-5757-5c6e-8864-086c8224160a with identifier: JX51559
2026-03-30 11:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82472134-5757-5c6e-8864-086c8224160a with scrape type 1
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_6747f787ad13a7239d296ab5f9b2f714.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6747f787ad13a7239d296ab5f9b2f714.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_8e6ce9f53a7ace1f80bf7286ab0f14cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_8e6ce9f53a7ace1f80bf7286ab0f14cf.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_cd3a60f8aaa9a9bd7dd658154f9c8d0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_cd3a60f8aaa9a9bd7dd658154f9c8d0d.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_c27e5854b746fe4ee80a91a0fabf6ae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_c27e5854b746fe4ee80a91a0fabf6ae9.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_d199be8c5c82fcb8f828bdb1b3944258.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_d199be8c5c82fcb8f828bdb1b3944258.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_6ea5085ee4c6046b26f1eef47ab18e80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6ea5085ee4c6046b26f1eef47ab18e80.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_eb9edc18f3ce1a51cf0fe2dca59869e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_eb9edc18f3ce1a51cf0fe2dca59869e2.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_89dd203e6ff9381648feb0f6be94a745.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_89dd203e6ff9381648feb0f6be94a745.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_83d809e0f8abd3e7b8d184e0ccfde7c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_83d809e0f8abd3e7b8d184e0ccfde7c0.jpg not downloaded yet
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_9c14d6eb01ca41ef37dde50a740747a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_9c14d6eb01ca41ef37dde50a740747a3.jpg not downloaded yet
2026-03-30 11:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM44657> (referer: https://www.auto1.com/v1/car-details-view/GM44657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc5573f-30c9-5beb-82da-919f9e94aa76 with identifier: GM44657
2026-03-30 11:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc5573f-30c9-5beb-82da-919f9e94aa76 with scrape type 1
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfc5573f-30c9-5beb-82da-919f9e94aa76
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_35dd4778d0c8f4d356ccaa3a5087a6b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_35dd4778d0c8f4d356ccaa3a5087a6b1.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_79fc447d0bb28c7c759fd17b191a5cad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_79fc447d0bb28c7c759fd17b191a5cad.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_4cdf2eca82daf4e78b58e58560cf9d22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_4cdf2eca82daf4e78b58e58560cf9d22.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_19b4ba1f8458d4813cff6862ad52da7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_19b4ba1f8458d4813cff6862ad52da7d.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_acfdee11ea39700b78dd6ad564b0af15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_acfdee11ea39700b78dd6ad564b0af15.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_7010b2f2d7590f2b9c73efb5a4be467e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_7010b2f2d7590f2b9c73efb5a4be467e.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_5b73f251e165b032f52ab4ecc775c59c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_5b73f251e165b032f52ab4ecc775c59c.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_239a0082f49989f04549daf060c48f7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_239a0082f49989f04549daf060c48f7c.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_e6fa282f4b3635102d11646abaf4db2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_e6fa282f4b3635102d11646abaf4db2b.jpg already downloaded
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F44%252F7844ca4a256453fd5afcb8de2ce9c89a%252Fpa%252FGM44657_a75577edf7e95b9b32a144b20dad47cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_a75577edf7e95b9b32a144b20dad47cd.jpg already downloaded
2026-03-30 11:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dfc5573f-30c9-5beb-82da-919f9e94aa76, identifier: GM44657
2026-03-30 11:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dfc5573f-30c9-5beb-82da-919f9e94aa76 with identifier: GM44657
2026-03-30 11:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dfc5573f-30c9-5beb-82da-919f9e94aa76 with identifier: GM44657
2026-03-30 11:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dfc5573f-30c9-5beb-82da-919f9e94aa76 with identifier: GM44657 to the API
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM44657>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:03:09Z',
 'fuel_type': 'petrol',
 'id': 'dfc5573f-30c9-5beb-82da-919f9e94aa76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM44657',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 73892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_35dd4778d0c8f4d356ccaa3a5087a6b1.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_79fc447d0bb28c7c759fd17b191a5cad.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_4cdf2eca82daf4e78b58e58560cf9d22.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_19b4ba1f8458d4813cff6862ad52da7d.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_acfdee11ea39700b78dd6ad564b0af15.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_7010b2f2d7590f2b9c73efb5a4be467e.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_5b73f251e165b032f52ab4ecc775c59c.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_239a0082f49989f04549daf060c48f7c.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_e6fa282f4b3635102d11646abaf4db2b.jpg',
                'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_a75577edf7e95b9b32a144b20dad47cd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_35dd4778d0c8f4d356ccaa3a5087a6b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_79fc447d0bb28c7c759fd17b191a5cad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_4cdf2eca82daf4e78b58e58560cf9d22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_19b4ba1f8458d4813cff6862ad52da7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_acfdee11ea39700b78dd6ad564b0af15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_7010b2f2d7590f2b9c73efb5a4be467e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_5b73f251e165b032f52ab4ecc775c59c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_239a0082f49989f04549daf060c48f7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_e6fa282f4b3635102d11646abaf4db2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc5573f-30c9-5beb-82da-919f9e94aa76/dfc5573f-30c9-5beb-82da-919f9e94aa76_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/44/7844ca4a256453fd5afcb8de2ce9c89a/pa/GM44657_a75577edf7e95b9b32a144b20dad47cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2024}
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM44657%27 HTTP/1.1" 200 None
2026-03-30 11:43:23 [auto1.be] INFO: Saving data for GM44657: {'created_time': 1774871003.107253, 'last_price_update_time': 1774871003.107266, 'auction_closing_time': 1774969389.0}
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM44657') HTTP/1.1" 204 0
2026-03-30 11:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_9c14d6eb01ca41ef37dde50a740747a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:23 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.854(s), this was the 1st time calling it.
2026-03-30 11:43:23 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.053413091618949 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de7d9c10>
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_9c14d6eb01ca41ef37dde50a740747a3.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_9c14d6eb01ca41ef37dde50a740747a3.jpg saved to cache
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_83d809e0f8abd3e7b8d184e0ccfde7c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71e910>
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_83d809e0f8abd3e7b8d184e0ccfde7c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_83d809e0f8abd3e7b8d184e0ccfde7c0.jpg saved to cache
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_89dd203e6ff9381648feb0f6be94a745.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc759bd0>
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_89dd203e6ff9381648feb0f6be94a745.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_89dd203e6ff9381648feb0f6be94a745.jpg saved to cache
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_eb9edc18f3ce1a51cf0fe2dca59869e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994790>
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_eb9edc18f3ce1a51cf0fe2dca59869e2.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_eb9edc18f3ce1a51cf0fe2dca59869e2.jpg saved to cache
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6ea5085ee4c6046b26f1eef47ab18e80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca1b850>
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_6ea5085ee4c6046b26f1eef47ab18e80.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6ea5085ee4c6046b26f1eef47ab18e80.jpg saved to cache
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_d199be8c5c82fcb8f828bdb1b3944258.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT85066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca52d50>
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_d199be8c5c82fcb8f828bdb1b3944258.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_d199be8c5c82fcb8f828bdb1b3944258.jpg saved to cache
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_cd3a60f8aaa9a9bd7dd658154f9c8d0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_c27e5854b746fe4ee80a91a0fabf6ae9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_8e6ce9f53a7ace1f80bf7286ab0f14cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7afa50>
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_cd3a60f8aaa9a9bd7dd658154f9c8d0d.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_cd3a60f8aaa9a9bd7dd658154f9c8d0d.jpg saved to cache
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc72fd50>
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_c27e5854b746fe4ee80a91a0fabf6ae9.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_c27e5854b746fe4ee80a91a0fabf6ae9.jpg saved to cache
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca4c090>
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_8e6ce9f53a7ace1f80bf7286ab0f14cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_8e6ce9f53a7ace1f80bf7286ab0f14cf.jpg saved to cache
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6747f787ad13a7239d296ab5f9b2f714.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75a310>
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252Fcc%252F1cccc99f5ccebed0d51917c116ea0bbd%252Fpa%252FJX51559_6747f787ad13a7239d296ab5f9b2f714.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6747f787ad13a7239d296ab5f9b2f714.jpg saved to cache
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82472134-5757-5c6e-8864-086c8224160a
2026-03-30 11:43:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82472134-5757-5c6e-8864-086c8224160a, skipping ID generation
2026-03-30 11:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82472134-5757-5c6e-8864-086c8224160a with scrape type 1
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82472134-5757-5c6e-8864-086c8224160a sending to next pipeline
2026-03-30 11:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 82472134-5757-5c6e-8864-086c8224160a, identifier: JX51559
2026-03-30 11:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 82472134-5757-5c6e-8864-086c8224160a with identifier: JX51559
2026-03-30 11:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 82472134-5757-5c6e-8864-086c8224160a with identifier: JX51559
2026-03-30 11:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 82472134-5757-5c6e-8864-086c8224160a with identifier: JX51559 to the API
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6747f787ad13a7239d296ab5f9b2f714.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:21:31Z',
 'fuel_type': 'petrol',
 'id': '82472134-5757-5c6e-8864-086c8224160a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX51559',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 135426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6747f787ad13a7239d296ab5f9b2f714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_8e6ce9f53a7ace1f80bf7286ab0f14cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_cd3a60f8aaa9a9bd7dd658154f9c8d0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_c27e5854b746fe4ee80a91a0fabf6ae9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_d199be8c5c82fcb8f828bdb1b3944258.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_6ea5085ee4c6046b26f1eef47ab18e80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_eb9edc18f3ce1a51cf0fe2dca59869e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_89dd203e6ff9381648feb0f6be94a745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_83d809e0f8abd3e7b8d184e0ccfde7c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82472134-5757-5c6e-8864-086c8224160a/82472134-5757-5c6e-8864-086c8224160a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/cc/1cccc99f5ccebed0d51917c116ea0bbd/pa/JX51559_9c14d6eb01ca41ef37dde50a740747a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 T2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2019}
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX51559%27 HTTP/1.1" 200 None
2026-03-30 11:43:25 [auto1.be] INFO: Saving data for JX51559: {'created_time': 1774871005.250507, 'last_price_update_time': 1774871005.25052, 'auction_closing_time': 1774970491.0}
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX51559') HTTP/1.1" 204 0
2026-03-30 11:43:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.123(s), this was the 1st time calling it.
2026-03-30 11:43:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.099225097871206 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP73013> (referer: https://www.auto1.com/v1/car-details-view/KP73013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72 with identifier: KP73013
2026-03-30 11:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72 with scrape type 1
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_8d6fd1fa8781127d6ae7a0703c68a497.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_8d6fd1fa8781127d6ae7a0703c68a497.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_005e0c6d619c988408100e282a5166bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_005e0c6d619c988408100e282a5166bd.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_f6432f5504eeaca0284ff8277e6f0099.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_f6432f5504eeaca0284ff8277e6f0099.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_42388d4f17c628a12ec94c77f456b194.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_42388d4f17c628a12ec94c77f456b194.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_fe1ce6c8e50a0ba0ba100b44b9242afe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_fe1ce6c8e50a0ba0ba100b44b9242afe.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_7075d0e03f23590f7eae70d8d6c4c97b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_7075d0e03f23590f7eae70d8d6c4c97b.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_c4d2dac2174b8dbe73bbde3cc760ae66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_c4d2dac2174b8dbe73bbde3cc760ae66.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_291f45e86ea11c22ba2b440b5cd67594.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_291f45e86ea11c22ba2b440b5cd67594.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_4f10b7b0e308e5f121cb598093970a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_4f10b7b0e308e5f121cb598093970a35.jpg not downloaded yet
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_5dce78285a9b7669e7d5026c897bf0d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_5dce78285a9b7669e7d5026c897bf0d6.jpg not downloaded yet
2026-03-30 11:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ46887/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_5dce78285a9b7669e7d5026c897bf0d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca44610>
2026-03-30 11:43:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_5dce78285a9b7669e7d5026c897bf0d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_5dce78285a9b7669e7d5026c897bf0d6.jpg saved to cache
2026-03-30 11:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN98541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_4f10b7b0e308e5f121cb598093970a35.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f7110>
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_4f10b7b0e308e5f121cb598093970a35.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_4f10b7b0e308e5f121cb598093970a35.jpg saved to cache
2026-03-30 11:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_291f45e86ea11c22ba2b440b5cd67594.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca51a90>
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_291f45e86ea11c22ba2b440b5cd67594.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_291f45e86ea11c22ba2b440b5cd67594.jpg saved to cache
2026-03-30 11:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM23300> (referer: https://www.auto1.com/v1/car-details-view/LM23300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6668210-7b2b-59d4-8f99-6a2fbdb2d47c with identifier: LM23300
2026-03-30 11:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c with scrape type 1
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_cff02ab69b251e11a8e2cbeb894206fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cff02ab69b251e11a8e2cbeb894206fa.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_98cd3be78e539494b2dc9e2ad960ede5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_98cd3be78e539494b2dc9e2ad960ede5.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_cb58de248122334878bda356a5571ade.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cb58de248122334878bda356a5571ade.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_2d957550e186008ec702fecd332e090b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_2d957550e186008ec702fecd332e090b.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_b26f9fd8f6740d68ad3d0df8b4df8d20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b26f9fd8f6740d68ad3d0df8b4df8d20.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_49572437682889c9a5fba9d658bd573b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_49572437682889c9a5fba9d658bd573b.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_53e5938c88fb78275936c83aebe2730a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_53e5938c88fb78275936c83aebe2730a.jpg not downloaded yet
2026-03-30 11:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_c4d2dac2174b8dbe73bbde3cc760ae66.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_573d7249b4064a97dd3b645d5d235cb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_573d7249b4064a97dd3b645d5d235cb9.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_b313f37b1705f59da97c110a99943409.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b313f37b1705f59da97c110a99943409.jpg not downloaded yet
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_b0ef1bdec50f60550699ba8ec174f051.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b0ef1bdec50f60550699ba8ec174f051.jpg not downloaded yet
2026-03-30 11:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_49572437682889c9a5fba9d658bd573b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc997f90>
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_c4d2dac2174b8dbe73bbde3cc760ae66.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_c4d2dac2174b8dbe73bbde3cc760ae66.jpg saved to cache
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca1be10>
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_49572437682889c9a5fba9d658bd573b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_49572437682889c9a5fba9d658bd573b.jpg saved to cache
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b0ef1bdec50f60550699ba8ec174f051.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6dab50>
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_b0ef1bdec50f60550699ba8ec174f051.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b0ef1bdec50f60550699ba8ec174f051.jpg saved to cache
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b313f37b1705f59da97c110a99943409.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_573d7249b4064a97dd3b645d5d235cb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc79d690>
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_b313f37b1705f59da97c110a99943409.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b313f37b1705f59da97c110a99943409.jpg saved to cache
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc79c190>
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_573d7249b4064a97dd3b645d5d235cb9.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_573d7249b4064a97dd3b645d5d235cb9.jpg saved to cache
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_53e5938c88fb78275936c83aebe2730a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86d410>
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_53e5938c88fb78275936c83aebe2730a.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_53e5938c88fb78275936c83aebe2730a.jpg saved to cache
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b26f9fd8f6740d68ad3d0df8b4df8d20.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_2d957550e186008ec702fecd332e090b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b09d0>
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_b26f9fd8f6740d68ad3d0df8b4df8d20.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b26f9fd8f6740d68ad3d0df8b4df8d20.jpg saved to cache
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6f82d0>
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_2d957550e186008ec702fecd332e090b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_2d957550e186008ec702fecd332e090b.jpg saved to cache
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD71561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cb58de248122334878bda356a5571ade.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_98cd3be78e539494b2dc9e2ad960ede5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cff02ab69b251e11a8e2cbeb894206fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b3110>
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_cb58de248122334878bda356a5571ade.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cb58de248122334878bda356a5571ade.jpg saved to cache
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6f8810>
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_98cd3be78e539494b2dc9e2ad960ede5.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_98cd3be78e539494b2dc9e2ad960ede5.jpg saved to cache
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d8f10>
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F59%252F275964dbfaefa8f42cde522081eadd73%252Fpa%252FLM23300_cff02ab69b251e11a8e2cbeb894206fa.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cff02ab69b251e11a8e2cbeb894206fa.jpg saved to cache
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c
2026-03-30 11:43:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6668210-7b2b-59d4-8f99-6a2fbdb2d47c, skipping ID generation
2026-03-30 11:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c with scrape type 1
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6668210-7b2b-59d4-8f99-6a2fbdb2d47c sending to next pipeline
2026-03-30 11:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a6668210-7b2b-59d4-8f99-6a2fbdb2d47c, identifier: LM23300
2026-03-30 11:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a6668210-7b2b-59d4-8f99-6a2fbdb2d47c with identifier: LM23300
2026-03-30 11:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a6668210-7b2b-59d4-8f99-6a2fbdb2d47c with identifier: LM23300
2026-03-30 11:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a6668210-7b2b-59d4-8f99-6a2fbdb2d47c with identifier: LM23300 to the API
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cff02ab69b251e11a8e2cbeb894206fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:02:25Z',
 'fuel_type': 'diesel',
 'id': 'a6668210-7b2b-59d4-8f99-6a2fbdb2d47c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM23300',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 30153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cff02ab69b251e11a8e2cbeb894206fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_98cd3be78e539494b2dc9e2ad960ede5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_cb58de248122334878bda356a5571ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_2d957550e186008ec702fecd332e090b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b26f9fd8f6740d68ad3d0df8b4df8d20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_49572437682889c9a5fba9d658bd573b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_53e5938c88fb78275936c83aebe2730a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_573d7249b4064a97dd3b645d5d235cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b313f37b1705f59da97c110a99943409.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6668210-7b2b-59d4-8f99-6a2fbdb2d47c/a6668210-7b2b-59d4-8f99-6a2fbdb2d47c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/59/275964dbfaefa8f42cde522081eadd73/pa/LM23300_b0ef1bdec50f60550699ba8ec174f051.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM23300%27 HTTP/1.1" 200 None
2026-03-30 11:43:38 [auto1.be] INFO: Saving data for LM23300: {'created_time': 1774871018.792021, 'last_price_update_time': 1774871018.792038, 'auction_closing_time': 1774969345.0}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM23300') HTTP/1.1" 204 0
2026-03-30 11:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_7075d0e03f23590f7eae70d8d6c4c97b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc818dd0>
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_7075d0e03f23590f7eae70d8d6c4c97b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_7075d0e03f23590f7eae70d8d6c4c97b.jpg saved to cache
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH47402> (referer: https://www.auto1.com/v1/car-details-view/PH47402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_fe1ce6c8e50a0ba0ba100b44b9242afe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_42388d4f17c628a12ec94c77f456b194.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 248292ec-3034-5881-83b0-27b945044e5f with identifier: PH47402
2026-03-30 11:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 248292ec-3034-5881-83b0-27b945044e5f with scrape type 1
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 248292ec-3034-5881-83b0-27b945044e5f
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_6926d1edac046ea5017788b1b9d56715.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_6926d1edac046ea5017788b1b9d56715.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_b4dcdb3791a2fcb4231d0bf081a16fc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_b4dcdb3791a2fcb4231d0bf081a16fc1.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_472f560596b0e0f68235ef5c7a354add.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_472f560596b0e0f68235ef5c7a354add.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_0470afbe5bbdc9f6671ea821446d52d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_0470afbe5bbdc9f6671ea821446d52d5.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_5072b2f11b5cf4dd95ec5b42c5e0856f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_5072b2f11b5cf4dd95ec5b42c5e0856f.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_98ac67988e129f8646481e45446aa8ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_98ac67988e129f8646481e45446aa8ef.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_10b286c9cbf9468799078b70bbe4403a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_10b286c9cbf9468799078b70bbe4403a.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_629d3bc960c3920262857de64af378d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_629d3bc960c3920262857de64af378d3.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_6730fa44042c534e3f0160d04a97fb95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_6730fa44042c534e3f0160d04a97fb95.jpg already downloaded
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F28%252F182806a1447983c2d22b454f2521b70c%252Fpa%252FPH47402_63179862bef578740d72587b8d50b77d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_63179862bef578740d72587b8d50b77d.jpg already downloaded
2026-03-30 11:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 248292ec-3034-5881-83b0-27b945044e5f, identifier: PH47402
2026-03-30 11:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 248292ec-3034-5881-83b0-27b945044e5f with identifier: PH47402
2026-03-30 11:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 248292ec-3034-5881-83b0-27b945044e5f with identifier: PH47402
2026-03-30 11:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 248292ec-3034-5881-83b0-27b945044e5f with identifier: PH47402 to the API
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PH47402>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:33:46Z',
 'fuel_type': 'petrol',
 'id': '248292ec-3034-5881-83b0-27b945044e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH47402',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 20907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 29,
 'photo_urls': ['https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_6926d1edac046ea5017788b1b9d56715.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_b4dcdb3791a2fcb4231d0bf081a16fc1.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_472f560596b0e0f68235ef5c7a354add.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_0470afbe5bbdc9f6671ea821446d52d5.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_5072b2f11b5cf4dd95ec5b42c5e0856f.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_98ac67988e129f8646481e45446aa8ef.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_10b286c9cbf9468799078b70bbe4403a.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_629d3bc960c3920262857de64af378d3.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_6730fa44042c534e3f0160d04a97fb95.jpg',
                'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_63179862bef578740d72587b8d50b77d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_6926d1edac046ea5017788b1b9d56715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_b4dcdb3791a2fcb4231d0bf081a16fc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_472f560596b0e0f68235ef5c7a354add.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_0470afbe5bbdc9f6671ea821446d52d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_5072b2f11b5cf4dd95ec5b42c5e0856f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_98ac67988e129f8646481e45446aa8ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_10b286c9cbf9468799078b70bbe4403a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_629d3bc960c3920262857de64af378d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_6730fa44042c534e3f0160d04a97fb95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_248292ec-3034-5881-83b0-27b945044e5f/248292ec-3034-5881-83b0-27b945044e5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/28/182806a1447983c2d22b454f2521b70c/pa/PH47402_63179862bef578740d72587b8d50b77d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH47402%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [auto1.be] INFO: Saving data for PH47402: {'created_time': 1774871019.816745, 'last_price_update_time': 1774871019.816756, 'auction_closing_time': 1774971226.0}
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH47402') HTTP/1.1" 204 0
2026-03-30 11:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_f6432f5504eeaca0284ff8277e6f0099.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_005e0c6d619c988408100e282a5166bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc845010>
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_fe1ce6c8e50a0ba0ba100b44b9242afe.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_fe1ce6c8e50a0ba0ba100b44b9242afe.jpg saved to cache
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb21610>
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_42388d4f17c628a12ec94c77f456b194.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_42388d4f17c628a12ec94c77f456b194.jpg saved to cache
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc796c10>
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_f6432f5504eeaca0284ff8277e6f0099.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_f6432f5504eeaca0284ff8277e6f0099.jpg saved to cache
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7a8050>
2026-03-30 11:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_005e0c6d619c988408100e282a5166bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_005e0c6d619c988408100e282a5166bd.jpg saved to cache
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_8d6fd1fa8781127d6ae7a0703c68a497.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca55b50>
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F94%252Fc79498288e5e010d15cad2508a0e6897%252Fpa%252FKP73013_8d6fd1fa8781127d6ae7a0703c68a497.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_8d6fd1fa8781127d6ae7a0703c68a497.jpg saved to cache
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72
2026-03-30 11:43:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72, skipping ID generation
2026-03-30 11:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72 with scrape type 1
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72 sending to next pipeline
2026-03-30 11:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72, identifier: KP73013
2026-03-30 11:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72 with identifier: KP73013
2026-03-30 11:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72 with identifier: KP73013
2026-03-30 11:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72 with identifier: KP73013 to the API
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_8d6fd1fa8781127d6ae7a0703c68a497.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '0.7L',
 'engine_horse_power': 50,
 'expiration_date': '2026-03-31T15:19:30Z',
 'fuel_type': 'petrol',
 'id': '747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP73013',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 46071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_8d6fd1fa8781127d6ae7a0703c68a497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_005e0c6d619c988408100e282a5166bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_f6432f5504eeaca0284ff8277e6f0099.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_42388d4f17c628a12ec94c77f456b194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_fe1ce6c8e50a0ba0ba100b44b9242afe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_7075d0e03f23590f7eae70d8d6c4c97b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_c4d2dac2174b8dbe73bbde3cc760ae66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_291f45e86ea11c22ba2b440b5cd67594.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_4f10b7b0e308e5f121cb598093970a35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72/747c0ad8-7f3c-5cc8-b6ad-ecb48d025d72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/94/c79498288e5e010d15cad2508a0e6897/pa/KP73013_5dce78285a9b7669e7d5026c897bf0d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis pure',
 'transmission': 'automatic',
 'trim': 'Basis pure',
 'year': 2004}
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP73013%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [auto1.be] INFO: Saving data for KP73013: {'created_time': 1774871020.9006, 'last_price_update_time': 1774871020.900616, 'auction_closing_time': 1774970370.0}
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP73013') HTTP/1.1" 204 0
2026-03-30 11:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT71941> (referer: https://www.auto1.com/v1/car-details-view/XT71941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d582d3-0195-5e62-8adf-090e371f4440 with identifier: XT71941
2026-03-30 11:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d582d3-0195-5e62-8adf-090e371f4440 with scrape type 1
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_7abf74eed7698622aba3bd0ce40eee6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_7abf74eed7698622aba3bd0ce40eee6c.jpg not downloaded yet
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_42df13fcc425705db884f1c5e4253c0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_42df13fcc425705db884f1c5e4253c0f.jpg not downloaded yet
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_9b2ff042ff756a3399459066d7926c4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_9b2ff042ff756a3399459066d7926c4d.jpg not downloaded yet
2026-03-30 11:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP37607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_90dc1efbe9a49f119d77696fb9c05330.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_90dc1efbe9a49f119d77696fb9c05330.jpg not downloaded yet
2026-03-30 11:43:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_7abf74eed7698622aba3bd0ce40eee6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_63d1a2d26b1b248220d3225dc6236004.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_63d1a2d26b1b248220d3225dc6236004.jpg not downloaded yet
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_871bb53e97e904fd622d74245b565dc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_871bb53e97e904fd622d74245b565dc4.jpg not downloaded yet
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_fa46b12d88123e339d35d20098d8a5c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_fa46b12d88123e339d35d20098d8a5c2.jpg not downloaded yet
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_a79e574da9bae29542867b6708b78e88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_a79e574da9bae29542867b6708b78e88.jpg not downloaded yet
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_ec809ec8a2246a56a53e802ffd3ddf24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_ec809ec8a2246a56a53e802ffd3ddf24.jpg not downloaded yet
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_9b2ff042ff756a3399459066d7926c4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_cdf449e6b1937e5aea36c63c78d1ee22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_cdf449e6b1937e5aea36c63c78d1ee22.jpg not downloaded yet
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc997a10>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_7abf74eed7698622aba3bd0ce40eee6c.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_7abf74eed7698622aba3bd0ce40eee6c.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_ec809ec8a2246a56a53e802ffd3ddf24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_42df13fcc425705db884f1c5e4253c0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc796110>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_9b2ff042ff756a3399459066d7926c4d.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_9b2ff042ff756a3399459066d7926c4d.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_cdf449e6b1937e5aea36c63c78d1ee22.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b3610>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_ec809ec8a2246a56a53e802ffd3ddf24.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_ec809ec8a2246a56a53e802ffd3ddf24.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_90dc1efbe9a49f119d77696fb9c05330.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca55b50>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_42df13fcc425705db884f1c5e4253c0f.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_42df13fcc425705db884f1c5e4253c0f.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc934750>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_cdf449e6b1937e5aea36c63c78d1ee22.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_cdf449e6b1937e5aea36c63c78d1ee22.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_fa46b12d88123e339d35d20098d8a5c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86f690>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_90dc1efbe9a49f119d77696fb9c05330.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_90dc1efbe9a49f119d77696fb9c05330.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_a79e574da9bae29542867b6708b78e88.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_63d1a2d26b1b248220d3225dc6236004.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8557d0>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_fa46b12d88123e339d35d20098d8a5c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_fa46b12d88123e339d35d20098d8a5c2.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86ea10>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_a79e574da9bae29542867b6708b78e88.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_a79e574da9bae29542867b6708b78e88.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_871bb53e97e904fd622d74245b565dc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca524d0>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_63d1a2d26b1b248220d3225dc6236004.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_63d1a2d26b1b248220d3225dc6236004.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc73d4d0>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F32%252F6032939bd7f6bc44bda18f5ddda88348%252Fpa%252FXT71941_871bb53e97e904fd622d74245b565dc4.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_871bb53e97e904fd622d74245b565dc4.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5d582d3-0195-5e62-8adf-090e371f4440
2026-03-30 11:43:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5d582d3-0195-5e62-8adf-090e371f4440, skipping ID generation
2026-03-30 11:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d582d3-0195-5e62-8adf-090e371f4440 with scrape type 1
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5d582d3-0195-5e62-8adf-090e371f4440 sending to next pipeline
2026-03-30 11:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f5d582d3-0195-5e62-8adf-090e371f4440, identifier: XT71941
2026-03-30 11:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f5d582d3-0195-5e62-8adf-090e371f4440 with identifier: XT71941
2026-03-30 11:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f5d582d3-0195-5e62-8adf-090e371f4440 with identifier: XT71941
2026-03-30 11:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f5d582d3-0195-5e62-8adf-090e371f4440 with identifier: XT71941 to the API
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_871bb53e97e904fd622d74245b565dc4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 223,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:59:23Z',
 'fuel_type': 'diesel',
 'id': 'f5d582d3-0195-5e62-8adf-090e371f4440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT71941',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Mercedes-Benz',
 'model': 'R-Klasse',
 'odometer': 266574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_7abf74eed7698622aba3bd0ce40eee6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_42df13fcc425705db884f1c5e4253c0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_9b2ff042ff756a3399459066d7926c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_90dc1efbe9a49f119d77696fb9c05330.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_63d1a2d26b1b248220d3225dc6236004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_871bb53e97e904fd622d74245b565dc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_fa46b12d88123e339d35d20098d8a5c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_a79e574da9bae29542867b6708b78e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_ec809ec8a2246a56a53e802ffd3ddf24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d582d3-0195-5e62-8adf-090e371f4440/f5d582d3-0195-5e62-8adf-090e371f4440_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/32/6032939bd7f6bc44bda18f5ddda88348/pa/XT71941_cdf449e6b1937e5aea36c63c78d1ee22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-14',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mercedes-Benz R-Klasse R 350 CDI L 4Matic Bluetec',
 'transmission': 'automatic',
 'trim': 'L 4Matic Bluetec',
 'year': 2012}
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT71941%27 HTTP/1.1" 200 None
2026-03-30 11:43:43 [auto1.be] INFO: Saving data for XT71941: {'created_time': 1774871023.360123, 'last_price_update_time': 1774871023.360133, 'auction_closing_time': 1774972763.0}
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT71941') HTTP/1.1" 204 0
2026-03-30 11:43:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.732(s), this was the 2nd time calling it.
2026-03-30 11:43:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.802245493202063 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG33358> (referer: https://www.auto1.com/v1/car-details-view/XG33358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0397fe2-b0aa-59f6-8bd2-8238e012a855 with identifier: XG33358
2026-03-30 11:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0397fe2-b0aa-59f6-8bd2-8238e012a855 with scrape type 1
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0397fe2-b0aa-59f6-8bd2-8238e012a855
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_5473208d6935a68751766f212a9ad258.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5473208d6935a68751766f212a9ad258.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_8c23812599bd522494ff9238e6b88c97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_8c23812599bd522494ff9238e6b88c97.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_bd3fc4d5a20fb489e657fe7165ab786c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_bd3fc4d5a20fb489e657fe7165ab786c.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_0b6a05e3476d9fe92c081ab6793f20cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_0b6a05e3476d9fe92c081ab6793f20cd.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_9564e84dc8f5adf36437c8df94e05979.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_9564e84dc8f5adf36437c8df94e05979.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_e22b7915ece979278ca9af641b2e20ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_e22b7915ece979278ca9af641b2e20ad.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_5a672d94296f40a3bbd59935f32068ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5a672d94296f40a3bbd59935f32068ff.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_5d2e84343dfdb31c22ac24364d14e80a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5d2e84343dfdb31c22ac24364d14e80a.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_581706cb0039f7aace952d6334ba63fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_581706cb0039f7aace952d6334ba63fc.jpg already downloaded
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F4c%252F864c15fb0a0e24953b810ef5b6a2fef4%252Fpa%252FXG33358_2f9b66d1fb7f1e0e36f535367d43c938.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_2f9b66d1fb7f1e0e36f535367d43c938.jpg already downloaded
2026-03-30 11:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0397fe2-b0aa-59f6-8bd2-8238e012a855, identifier: XG33358
2026-03-30 11:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0397fe2-b0aa-59f6-8bd2-8238e012a855 with identifier: XG33358
2026-03-30 11:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0397fe2-b0aa-59f6-8bd2-8238e012a855 with identifier: XG33358
2026-03-30 11:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0397fe2-b0aa-59f6-8bd2-8238e012a855 with identifier: XG33358 to the API
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XG33358>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:22:29Z',
 'fuel_type': 'petrol',
 'id': 'e0397fe2-b0aa-59f6-8bd2-8238e012a855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG33358',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 149990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photo_urls': ['https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5473208d6935a68751766f212a9ad258.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_8c23812599bd522494ff9238e6b88c97.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_bd3fc4d5a20fb489e657fe7165ab786c.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_0b6a05e3476d9fe92c081ab6793f20cd.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_9564e84dc8f5adf36437c8df94e05979.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_e22b7915ece979278ca9af641b2e20ad.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5a672d94296f40a3bbd59935f32068ff.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5d2e84343dfdb31c22ac24364d14e80a.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_581706cb0039f7aace952d6334ba63fc.jpg',
                'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_2f9b66d1fb7f1e0e36f535367d43c938.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5473208d6935a68751766f212a9ad258.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_8c23812599bd522494ff9238e6b88c97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_bd3fc4d5a20fb489e657fe7165ab786c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_0b6a05e3476d9fe92c081ab6793f20cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_9564e84dc8f5adf36437c8df94e05979.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_e22b7915ece979278ca9af641b2e20ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5a672d94296f40a3bbd59935f32068ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_5d2e84343dfdb31c22ac24364d14e80a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_581706cb0039f7aace952d6334ba63fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0397fe2-b0aa-59f6-8bd2-8238e012a855/e0397fe2-b0aa-59f6-8bd2-8238e012a855_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/4c/864c15fb0a0e24953b810ef5b6a2fef4/pa/XG33358_2f9b66d1fb7f1e0e36f535367d43c938.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volvo C30 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG33358%27 HTTP/1.1" 200 None
2026-03-30 11:43:53 [auto1.be] INFO: Saving data for XG33358: {'created_time': 1774871033.964931, 'last_price_update_time': 1774871033.964945, 'auction_closing_time': 1774970549.0}
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG33358') HTTP/1.1" 204 0
2026-03-30 11:43:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.925(s), this was the 1st time calling it.
2026-03-30 11:43:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7609156666716723 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:44:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.959(s), this was the 1st time calling it.
2026-03-30 11:44:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.727535786083136 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW35793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:06 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 17 pages/min), scraped 66 items (at 12 items/min)
2026-03-30 11:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 11:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ46887> (referer: https://www.auto1.com/v1/car-details-view/DZ46887/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b54f7a0-aa97-5e5a-90ac-50d29473202d with identifier: DZ46887
2026-03-30 11:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d with scrape type 1
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_784e2a1bf417c5f4c7300bbfb414a798.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_784e2a1bf417c5f4c7300bbfb414a798.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_474e52c019350582583cedd9239597a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_474e52c019350582583cedd9239597a1.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_1a2fb37c40fa545741cb0b061989224f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_1a2fb37c40fa545741cb0b061989224f.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_bd0b1f3122113c04a2d2e1998c08bfc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_bd0b1f3122113c04a2d2e1998c08bfc3.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_aba66258aa019e69eac7c69fc7c99815.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_aba66258aa019e69eac7c69fc7c99815.jpg not downloaded yet
2026-03-30 11:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_784e2a1bf417c5f4c7300bbfb414a798.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_474e52c019350582583cedd9239597a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_5e8a555068f0a3f33efef53558bf80d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_5e8a555068f0a3f33efef53558bf80d0.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_cf5c23a3c5b4825a303059ad4cea66fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_cf5c23a3c5b4825a303059ad4cea66fc.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_72ae88fc1e1a5fc7b456a8aa2399c024.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_72ae88fc1e1a5fc7b456a8aa2399c024.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_69a536e6327306b58aa1e87a04d63faf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_69a536e6327306b58aa1e87a04d63faf.jpg not downloaded yet
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_b02b79d24a5baf717ae2cd619ba300d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_b02b79d24a5baf717ae2cd619ba300d6.jpg not downloaded yet
2026-03-30 11:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_5e8a555068f0a3f33efef53558bf80d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc73e0d0>
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_784e2a1bf417c5f4c7300bbfb414a798.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_784e2a1bf417c5f4c7300bbfb414a798.jpg saved to cache
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc937d90>
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_474e52c019350582583cedd9239597a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_474e52c019350582583cedd9239597a1.jpg saved to cache
2026-03-30 11:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_b02b79d24a5baf717ae2cd619ba300d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc847f10>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_5e8a555068f0a3f33efef53558bf80d0.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_5e8a555068f0a3f33efef53558bf80d0.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_69a536e6327306b58aa1e87a04d63faf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_1a2fb37c40fa545741cb0b061989224f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_aba66258aa019e69eac7c69fc7c99815.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_72ae88fc1e1a5fc7b456a8aa2399c024.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc996d90>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_b02b79d24a5baf717ae2cd619ba300d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_b02b79d24a5baf717ae2cd619ba300d6.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc845410>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_69a536e6327306b58aa1e87a04d63faf.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_69a536e6327306b58aa1e87a04d63faf.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86d490>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_1a2fb37c40fa545741cb0b061989224f.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_1a2fb37c40fa545741cb0b061989224f.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc79cd10>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_aba66258aa019e69eac7c69fc7c99815.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_aba66258aa019e69eac7c69fc7c99815.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc99bdd0>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_72ae88fc1e1a5fc7b456a8aa2399c024.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_72ae88fc1e1a5fc7b456a8aa2399c024.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_bd0b1f3122113c04a2d2e1998c08bfc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_cf5c23a3c5b4825a303059ad4cea66fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deae51d0>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_bd0b1f3122113c04a2d2e1998c08bfc3.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_bd0b1f3122113c04a2d2e1998c08bfc3.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5cf250>
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fb8%252Fd9b820e5ffc0879717f0decc51e25ede%252Fpa%252FDZ46887_cf5c23a3c5b4825a303059ad4cea66fc.jpg') HTTP/1.1" 204 0
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_cf5c23a3c5b4825a303059ad4cea66fc.jpg saved to cache
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d
2026-03-30 11:44:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b54f7a0-aa97-5e5a-90ac-50d29473202d, skipping ID generation
2026-03-30 11:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d with scrape type 1
2026-03-30 11:44:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b54f7a0-aa97-5e5a-90ac-50d29473202d sending to next pipeline
2026-03-30 11:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b54f7a0-aa97-5e5a-90ac-50d29473202d, identifier: DZ46887
2026-03-30 11:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b54f7a0-aa97-5e5a-90ac-50d29473202d with identifier: DZ46887
2026-03-30 11:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b54f7a0-aa97-5e5a-90ac-50d29473202d with identifier: DZ46887
2026-03-30 11:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b54f7a0-aa97-5e5a-90ac-50d29473202d with identifier: DZ46887 to the API
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_cf5c23a3c5b4825a303059ad4cea66fc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:35:52Z',
 'fuel_type': 'petrol',
 'id': '9b54f7a0-aa97-5e5a-90ac-50d29473202d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ46887',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 177511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_784e2a1bf417c5f4c7300bbfb414a798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_474e52c019350582583cedd9239597a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_1a2fb37c40fa545741cb0b061989224f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_bd0b1f3122113c04a2d2e1998c08bfc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_aba66258aa019e69eac7c69fc7c99815.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_5e8a555068f0a3f33efef53558bf80d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_cf5c23a3c5b4825a303059ad4cea66fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_72ae88fc1e1a5fc7b456a8aa2399c024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_69a536e6327306b58aa1e87a04d63faf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b54f7a0-aa97-5e5a-90ac-50d29473202d/9b54f7a0-aa97-5e5a-90ac-50d29473202d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/b8/d9b820e5ffc0879717f0decc51e25ede/pa/DZ46887_b02b79d24a5baf717ae2cd619ba300d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-30 11:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ46887%27 HTTP/1.1" 200 None
2026-03-30 11:44:10 [auto1.be] INFO: Saving data for DZ46887: {'created_time': 1774871050.010263, 'last_price_update_time': 1774871050.010273, 'auction_closing_time': 1774971352.0}
2026-03-30 11:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ46887') HTTP/1.1" 204 0
2026-03-30 11:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN98541> (referer: https://www.auto1.com/v1/car-details-view/UN98541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3964c45-3350-5375-8fb1-b9d87081d781 with identifier: UN98541
2026-03-30 11:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3964c45-3350-5375-8fb1-b9d87081d781 with scrape type 1
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3964c45-3350-5375-8fb1-b9d87081d781
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_7399339a461981c997187333d043cbd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_7399339a461981c997187333d043cbd8.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_efbf14bf9a6d8e31b2b1bf2a271f2bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_efbf14bf9a6d8e31b2b1bf2a271f2bbb.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_5b36b735a183f2b91ed51411c1670a2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_5b36b735a183f2b91ed51411c1670a2c.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_a16896078b8befd45ef2c277feb13c80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_a16896078b8befd45ef2c277feb13c80.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_ea7984f549d6919656896236a30b904d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_ea7984f549d6919656896236a30b904d.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_4b8909ffa807c4dfedcd6ca241669c72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_4b8909ffa807c4dfedcd6ca241669c72.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_6ee4ab5c6c16026098442a9c4f6e278b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_6ee4ab5c6c16026098442a9c4f6e278b.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_b9b6dee569d4c0d92c6569bab3dd3a23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_b9b6dee569d4c0d92c6569bab3dd3a23.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_b3ad50d11fde9fb50ab90283e1cf8f55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_b3ad50d11fde9fb50ab90283e1cf8f55.jpg already downloaded
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff7%252Ffef7ceb86cebbd6d61ddcf86d07a1a87%252Fpa%252FUN98541_0b662b7303a2b74bc8f7776cd4002c63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_0b662b7303a2b74bc8f7776cd4002c63.jpg already downloaded
2026-03-30 11:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3964c45-3350-5375-8fb1-b9d87081d781, identifier: UN98541
2026-03-30 11:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3964c45-3350-5375-8fb1-b9d87081d781 with identifier: UN98541
2026-03-30 11:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3964c45-3350-5375-8fb1-b9d87081d781 with identifier: UN98541
2026-03-30 11:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3964c45-3350-5375-8fb1-b9d87081d781 with identifier: UN98541 to the API
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UN98541>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-03-31T15:42:17Z',
 'fuel_type': 'petrol',
 'id': 'c3964c45-3350-5375-8fb1-b9d87081d781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN98541',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 60647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_7399339a461981c997187333d043cbd8.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_efbf14bf9a6d8e31b2b1bf2a271f2bbb.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_5b36b735a183f2b91ed51411c1670a2c.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_a16896078b8befd45ef2c277feb13c80.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_ea7984f549d6919656896236a30b904d.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_4b8909ffa807c4dfedcd6ca241669c72.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_6ee4ab5c6c16026098442a9c4f6e278b.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_b9b6dee569d4c0d92c6569bab3dd3a23.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_b3ad50d11fde9fb50ab90283e1cf8f55.jpg',
                'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_0b662b7303a2b74bc8f7776cd4002c63.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_7399339a461981c997187333d043cbd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_efbf14bf9a6d8e31b2b1bf2a271f2bbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_5b36b735a183f2b91ed51411c1670a2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_a16896078b8befd45ef2c277feb13c80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_ea7984f549d6919656896236a30b904d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_4b8909ffa807c4dfedcd6ca241669c72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_6ee4ab5c6c16026098442a9c4f6e278b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_b9b6dee569d4c0d92c6569bab3dd3a23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385120,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_b3ad50d11fde9fb50ab90283e1cf8f55.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3964c45-3350-5375-8fb1-b9d87081d781/c3964c45-3350-5375-8fb1-b9d87081d781_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f7/fef7ceb86cebbd6d61ddcf86d07a1a87/pa/UN98541_0b662b7303a2b74bc8f7776cd4002c63.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN98541%27 HTTP/1.1" 200 None
2026-03-30 11:44:11 [auto1.be] INFO: Saving data for UN98541: {'created_time': 1774871051.791887, 'last_price_update_time': 1774871051.7919, 'auction_closing_time': 1774971737.0}
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UN98541') HTTP/1.1" 204 0
2026-03-30 11:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD71561> (referer: https://www.auto1.com/v1/car-details-view/YD71561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a7df6b2-2359-5613-b42f-0926a0f0a697 with identifier: YD71561
2026-03-30 11:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7df6b2-2359-5613-b42f-0926a0f0a697 with scrape type 1
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a7df6b2-2359-5613-b42f-0926a0f0a697
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_1f2f64f6b05ffae9437fa0ede3fafa24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_1f2f64f6b05ffae9437fa0ede3fafa24.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_9d52002f4c501f75e75600b87fc5968b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_9d52002f4c501f75e75600b87fc5968b.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_c903d88e1fa89f99152e0772e1e1f6c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_c903d88e1fa89f99152e0772e1e1f6c5.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_5f90792ed4ce8e6bd78b7513a86b661c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_5f90792ed4ce8e6bd78b7513a86b661c.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_514cf3fbd18696403676c096557d58e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_514cf3fbd18696403676c096557d58e4.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_2f4f25f6fe7d120dde1cdbdc1df675d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_2f4f25f6fe7d120dde1cdbdc1df675d7.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_a92ecdd7721f5f3dedbac4a9a4f5e793.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_a92ecdd7721f5f3dedbac4a9a4f5e793.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_56f76ceb5df0ae7b819d74e39c242ac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_56f76ceb5df0ae7b819d74e39c242ac4.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_aff06129001b24203576ee950eab42d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_aff06129001b24203576ee950eab42d0.jpg already downloaded
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F00%252F9a00e9b2e0e94fd6708a9e78945f0387%252Fpa%252FYD71561_37ea6e9fbc1a6dde3fe4e6cacc290df7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_37ea6e9fbc1a6dde3fe4e6cacc290df7.jpg already downloaded
2026-03-30 11:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a7df6b2-2359-5613-b42f-0926a0f0a697, identifier: YD71561
2026-03-30 11:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a7df6b2-2359-5613-b42f-0926a0f0a697 with identifier: YD71561
2026-03-30 11:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a7df6b2-2359-5613-b42f-0926a0f0a697 with identifier: YD71561
2026-03-30 11:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a7df6b2-2359-5613-b42f-0926a0f0a697 with identifier: YD71561 to the API
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YD71561>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:28Z',
 'fuel_type': 'diesel',
 'id': '7a7df6b2-2359-5613-b42f-0926a0f0a697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD71561',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 208954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_1f2f64f6b05ffae9437fa0ede3fafa24.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_9d52002f4c501f75e75600b87fc5968b.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_c903d88e1fa89f99152e0772e1e1f6c5.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_5f90792ed4ce8e6bd78b7513a86b661c.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_514cf3fbd18696403676c096557d58e4.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_2f4f25f6fe7d120dde1cdbdc1df675d7.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_a92ecdd7721f5f3dedbac4a9a4f5e793.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_56f76ceb5df0ae7b819d74e39c242ac4.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_aff06129001b24203576ee950eab42d0.jpg',
                'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_37ea6e9fbc1a6dde3fe4e6cacc290df7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_1f2f64f6b05ffae9437fa0ede3fafa24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_9d52002f4c501f75e75600b87fc5968b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_c903d88e1fa89f99152e0772e1e1f6c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_5f90792ed4ce8e6bd78b7513a86b661c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_514cf3fbd18696403676c096557d58e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_2f4f25f6fe7d120dde1cdbdc1df675d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_a92ecdd7721f5f3dedbac4a9a4f5e793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_56f76ceb5df0ae7b819d74e39c242ac4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_aff06129001b24203576ee950eab42d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7df6b2-2359-5613-b42f-0926a0f0a697/7a7df6b2-2359-5613-b42f-0926a0f0a697_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/00/9a00e9b2e0e94fd6708a9e78945f0387/pa/YD71561_37ea6e9fbc1a6dde3fe4e6cacc290df7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2017}
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD71561%27 HTTP/1.1" 200 None
2026-03-30 11:44:13 [auto1.be] INFO: Saving data for YD71561: {'created_time': 1774871053.88064, 'last_price_update_time': 1774871053.880652, 'auction_closing_time': 1774971268.0}
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YD71561') HTTP/1.1" 204 0
2026-03-30 11:44:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR73680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:06 [scrapy.extensions.logstats] INFO: Crawled 98 pages (at 4 pages/min), scraped 69 items (at 3 items/min)
2026-03-30 11:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 11:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ74080/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.505(s), this was the 2nd time calling it.
2026-03-30 11:45:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.267529995393416 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:45:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD84519/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR73680> (referer: https://www.auto1.com/v1/car-details-view/GR73680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c04a03-b500-52f9-b2ab-8dcd6560c6d2 with identifier: GR73680
2026-03-30 11:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c04a03-b500-52f9-b2ab-8dcd6560c6d2 with scrape type 1
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6c04a03-b500-52f9-b2ab-8dcd6560c6d2
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_5f9b3e9f1f01c383a1e9287a42da0c8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_5f9b3e9f1f01c383a1e9287a42da0c8e.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_e810f7d6c0cf68dc7cc4913fadb7c3fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_e810f7d6c0cf68dc7cc4913fadb7c3fc.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_6855ce494cf6bdb3ddbf57ca0835f0a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_6855ce494cf6bdb3ddbf57ca0835f0a1.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_6be5f8bbcc15a36d3d86dfba24e909ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_6be5f8bbcc15a36d3d86dfba24e909ff.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_34e00182a425751126eeff948ffc79b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_34e00182a425751126eeff948ffc79b9.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_91ac11c8ff562f2a263640b01a4d3418.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_91ac11c8ff562f2a263640b01a4d3418.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_0b453c2f944f39edc7c4aa2d812fd7fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_0b453c2f944f39edc7c4aa2d812fd7fe.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_5a646fae127527f9f1ee1fe275f0ea87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_5a646fae127527f9f1ee1fe275f0ea87.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_abb9e6e30ac728b248475745bb882963.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_abb9e6e30ac728b248475745bb882963.jpg already downloaded
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F24%252F2b24e7baf0c9d9d7536c585469ded021%252Fpa%252FGR73680_1785c6c29d2daed701521565a7978f2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_1785c6c29d2daed701521565a7978f2b.jpg already downloaded
2026-03-30 11:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e6c04a03-b500-52f9-b2ab-8dcd6560c6d2, identifier: GR73680
2026-03-30 11:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e6c04a03-b500-52f9-b2ab-8dcd6560c6d2 with identifier: GR73680
2026-03-30 11:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e6c04a03-b500-52f9-b2ab-8dcd6560c6d2 with identifier: GR73680
2026-03-30 11:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e6c04a03-b500-52f9-b2ab-8dcd6560c6d2 with identifier: GR73680 to the API
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR73680>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:29:36Z',
 'fuel_type': 'diesel',
 'id': 'e6c04a03-b500-52f9-b2ab-8dcd6560c6d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR73680',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 186832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_5f9b3e9f1f01c383a1e9287a42da0c8e.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_e810f7d6c0cf68dc7cc4913fadb7c3fc.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_6855ce494cf6bdb3ddbf57ca0835f0a1.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_6be5f8bbcc15a36d3d86dfba24e909ff.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_34e00182a425751126eeff948ffc79b9.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_91ac11c8ff562f2a263640b01a4d3418.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_0b453c2f944f39edc7c4aa2d812fd7fe.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_5a646fae127527f9f1ee1fe275f0ea87.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_abb9e6e30ac728b248475745bb882963.jpg',
                'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_1785c6c29d2daed701521565a7978f2b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_5f9b3e9f1f01c383a1e9287a42da0c8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_e810f7d6c0cf68dc7cc4913fadb7c3fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2278483,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_6855ce494cf6bdb3ddbf57ca0835f0a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_6be5f8bbcc15a36d3d86dfba24e909ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2298792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_34e00182a425751126eeff948ffc79b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_91ac11c8ff562f2a263640b01a4d3418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_0b453c2f944f39edc7c4aa2d812fd7fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_5a646fae127527f9f1ee1fe275f0ea87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_abb9e6e30ac728b248475745bb882963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c04a03-b500-52f9-b2ab-8dcd6560c6d2/e6c04a03-b500-52f9-b2ab-8dcd6560c6d2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2863946,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/24/2b24e7baf0c9d9d7536c585469ded021/pa/GR73680_1785c6c29d2daed701521565a7978f2b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR73680%27 HTTP/1.1" 200 None
2026-03-30 11:45:51 [auto1.be] INFO: Saving data for GR73680: {'created_time': 1774871151.098309, 'last_price_update_time': 1774871151.098319, 'auction_closing_time': 1774970976.0}
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR73680') HTTP/1.1" 204 0
2026-03-30 11:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ74080> (referer: https://www.auto1.com/v1/car-details-view/NZ74080/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a581a32-6762-5908-964c-d5f393b015d2 with identifier: NZ74080
2026-03-30 11:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a581a32-6762-5908-964c-d5f393b015d2 with scrape type 1
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0a581a32-6762-5908-964c-d5f393b015d2
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_d215b2d5d38cde03d3786540a680a47d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_d215b2d5d38cde03d3786540a680a47d.jpg not downloaded yet
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_c96871b8ccb5f387097302a481b5c53e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_c96871b8ccb5f387097302a481b5c53e.jpg not downloaded yet
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_b58a842ede54dd5b6eb41fd250c54bc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b58a842ede54dd5b6eb41fd250c54bc9.jpg not downloaded yet
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_b4d9920793dc2e9d2503288c627e2ea2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b4d9920793dc2e9d2503288c627e2ea2.jpg not downloaded yet
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_6681ac574f3562ce02856271d99e835e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_6681ac574f3562ce02856271d99e835e.jpg not downloaded yet
2026-03-30 11:45:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.188(s), this was the 1st time calling it.
2026-03-30 11:45:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.688218776588374 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:45:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.456(s), this was the 1st time calling it.
2026-03-30 11:45:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.854225957295464 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_d215b2d5d38cde03d3786540a680a47d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b4d9920793dc2e9d2503288c627e2ea2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_c96871b8ccb5f387097302a481b5c53e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8d8e50>
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_d215b2d5d38cde03d3786540a680a47d.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_d215b2d5d38cde03d3786540a680a47d.jpg saved to cache
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a581a32-6762-5908-964c-d5f393b015d2
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ac290>
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_b4d9920793dc2e9d2503288c627e2ea2.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b4d9920793dc2e9d2503288c627e2ea2.jpg saved to cache
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a581a32-6762-5908-964c-d5f393b015d2
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75fe50>
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_c96871b8ccb5f387097302a481b5c53e.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_c96871b8ccb5f387097302a481b5c53e.jpg saved to cache
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a581a32-6762-5908-964c-d5f393b015d2
2026-03-30 11:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_6681ac574f3562ce02856271d99e835e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b58a842ede54dd5b6eb41fd250c54bc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c0e90>
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_6681ac574f3562ce02856271d99e835e.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_6681ac574f3562ce02856271d99e835e.jpg saved to cache
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a581a32-6762-5908-964c-d5f393b015d2
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c1410>
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fea%252Fb8ea6e099e454a763ce95b19a98263f1%252Fpa%252FNZ74080_b58a842ede54dd5b6eb41fd250c54bc9.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b58a842ede54dd5b6eb41fd250c54bc9.jpg saved to cache
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a581a32-6762-5908-964c-d5f393b015d2
2026-03-30 11:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a581a32-6762-5908-964c-d5f393b015d2, skipping ID generation
2026-03-30 11:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a581a32-6762-5908-964c-d5f393b015d2 with scrape type 1
2026-03-30 11:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a581a32-6762-5908-964c-d5f393b015d2 sending to next pipeline
2026-03-30 11:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a581a32-6762-5908-964c-d5f393b015d2, identifier: NZ74080
2026-03-30 11:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a581a32-6762-5908-964c-d5f393b015d2 with identifier: NZ74080
2026-03-30 11:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a581a32-6762-5908-964c-d5f393b015d2 with identifier: NZ74080
2026-03-30 11:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a581a32-6762-5908-964c-d5f393b015d2 with identifier: NZ74080 to the API
2026-03-30 11:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b58a842ede54dd5b6eb41fd250c54bc9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.1L',
 'engine_horse_power': 58,
 'expiration_date': '2026-03-31T15:25:01Z',
 'fuel_type': 'petrol',
 'id': '0a581a32-6762-5908-964c-d5f393b015d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ74080',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'Hyundai',
 'model': 'Atos',
 'odometer': 100504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_d215b2d5d38cde03d3786540a680a47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_c96871b8ccb5f387097302a481b5c53e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b58a842ede54dd5b6eb41fd250c54bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_b4d9920793dc2e9d2503288c627e2ea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a581a32-6762-5908-964c-d5f393b015d2/0a581a32-6762-5908-964c-d5f393b015d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ea/b8ea6e099e454a763ce95b19a98263f1/pa/NZ74080_6681ac574f3562ce02856271d99e835e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-06-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Hyundai Atos 1.1',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74080%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [auto1.be] INFO: Saving data for NZ74080: {'created_time': 1774871153.123505, 'last_price_update_time': 1774871153.123515, 'auction_closing_time': 1774970701.0}
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ74080') HTTP/1.1" 204 0
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD84519> (referer: https://www.auto1.com/v1/car-details-view/UD84519/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6068775-5c33-5b50-8c2c-e3756d548f59 with identifier: UD84519
2026-03-30 11:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6068775-5c33-5b50-8c2c-e3756d548f59 with scrape type 1
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_9eae370b90329542eac0795f6c0b8d79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_9eae370b90329542eac0795f6c0b8d79.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_ed729cfa3ea1ae6cf12b465911ce484f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_ed729cfa3ea1ae6cf12b465911ce484f.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_757cc9d8013b3bb5aa52b189f91a0988.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_757cc9d8013b3bb5aa52b189f91a0988.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_73b0a5e6d03783f8cd725d62716ed781.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_73b0a5e6d03783f8cd725d62716ed781.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_f70527562fbfdb831dd23a3dc39086a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_f70527562fbfdb831dd23a3dc39086a0.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_d8fda200cd7562b0c85301488c85e028.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d8fda200cd7562b0c85301488c85e028.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_4cf07d558f0e0da9607da93dc0250a93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_4cf07d558f0e0da9607da93dc0250a93.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_09299f35d4454e805603a2acf13f22df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_09299f35d4454e805603a2acf13f22df.jpg not downloaded yet
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_525bb31bda5d7be5e34d1d51e571abd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_525bb31bda5d7be5e34d1d51e571abd5.jpg not downloaded yet
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_9eae370b90329542eac0795f6c0b8d79.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_d59736be44efef75d6adc8dbd45e4d0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d59736be44efef75d6adc8dbd45e4d0c.jpg not downloaded yet
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_525bb31bda5d7be5e34d1d51e571abd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_f70527562fbfdb831dd23a3dc39086a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_73b0a5e6d03783f8cd725d62716ed781.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca54f90>
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_9eae370b90329542eac0795f6c0b8d79.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_9eae370b90329542eac0795f6c0b8d79.jpg saved to cache
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_ed729cfa3ea1ae6cf12b465911ce484f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_757cc9d8013b3bb5aa52b189f91a0988.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca47ad0>
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_525bb31bda5d7be5e34d1d51e571abd5.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_525bb31bda5d7be5e34d1d51e571abd5.jpg saved to cache
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc79f3d0>
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_f70527562fbfdb831dd23a3dc39086a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_f70527562fbfdb831dd23a3dc39086a0.jpg saved to cache
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5d2b10>
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_73b0a5e6d03783f8cd725d62716ed781.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_73b0a5e6d03783f8cd725d62716ed781.jpg saved to cache
2026-03-30 11:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_4cf07d558f0e0da9607da93dc0250a93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_09299f35d4454e805603a2acf13f22df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d8fda200cd7562b0c85301488c85e028.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc72ec50>
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_ed729cfa3ea1ae6cf12b465911ce484f.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_ed729cfa3ea1ae6cf12b465911ce484f.jpg saved to cache
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca3ca90>
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_757cc9d8013b3bb5aa52b189f91a0988.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_757cc9d8013b3bb5aa52b189f91a0988.jpg saved to cache
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d59736be44efef75d6adc8dbd45e4d0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc856a10>
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_4cf07d558f0e0da9607da93dc0250a93.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_4cf07d558f0e0da9607da93dc0250a93.jpg saved to cache
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca6fe10>
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_09299f35d4454e805603a2acf13f22df.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_09299f35d4454e805603a2acf13f22df.jpg saved to cache
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75f310>
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_d8fda200cd7562b0c85301488c85e028.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d8fda200cd7562b0c85301488c85e028.jpg saved to cache
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dec18d50>
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb03a592d66eb55429ad42bcc39a7f4%252Fpa%252FUD84519_d59736be44efef75d6adc8dbd45e4d0c.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d59736be44efef75d6adc8dbd45e4d0c.jpg saved to cache
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6068775-5c33-5b50-8c2c-e3756d548f59
2026-03-30 11:45:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6068775-5c33-5b50-8c2c-e3756d548f59, skipping ID generation
2026-03-30 11:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6068775-5c33-5b50-8c2c-e3756d548f59 with scrape type 1
2026-03-30 11:45:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6068775-5c33-5b50-8c2c-e3756d548f59 sending to next pipeline
2026-03-30 11:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d6068775-5c33-5b50-8c2c-e3756d548f59, identifier: UD84519
2026-03-30 11:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d6068775-5c33-5b50-8c2c-e3756d548f59 with identifier: UD84519
2026-03-30 11:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d6068775-5c33-5b50-8c2c-e3756d548f59 with identifier: UD84519
2026-03-30 11:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d6068775-5c33-5b50-8c2c-e3756d548f59 with identifier: UD84519 to the API
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d59736be44efef75d6adc8dbd45e4d0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:09:48Z',
 'fuel_type': 'diesel',
 'id': 'd6068775-5c33-5b50-8c2c-e3756d548f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD84519',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 168861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_9eae370b90329542eac0795f6c0b8d79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_ed729cfa3ea1ae6cf12b465911ce484f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_757cc9d8013b3bb5aa52b189f91a0988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2427851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_73b0a5e6d03783f8cd725d62716ed781.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_f70527562fbfdb831dd23a3dc39086a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d8fda200cd7562b0c85301488c85e028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_4cf07d558f0e0da9607da93dc0250a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_09299f35d4454e805603a2acf13f22df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_525bb31bda5d7be5e34d1d51e571abd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6068775-5c33-5b50-8c2c-e3756d548f59/d6068775-5c33-5b50-8c2c-e3756d548f59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1195324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb03a592d66eb55429ad42bcc39a7f4/pa/UD84519_d59736be44efef75d6adc8dbd45e4d0c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2020}
2026-03-30 11:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD84519%27 HTTP/1.1" 200 None
2026-03-30 11:45:55 [auto1.be] INFO: Saving data for UD84519: {'created_time': 1774871155.058321, 'last_price_update_time': 1774871155.058331, 'auction_closing_time': 1774969788.0}
2026-03-30 11:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD84519') HTTP/1.1" 204 0
2026-03-30 11:45:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:45:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:46:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.414(s), this was the 1st time calling it.
2026-03-30 11:46:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.722450637246931 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:46:06 [scrapy.extensions.logstats] INFO: Crawled 103 pages (at 5 pages/min), scraped 72 items (at 3 items/min)
2026-03-30 11:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-30 11:46:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:07 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1764 | hits on page: 40
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: GM44657
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM44657%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for GM44657: 0
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: RF68102
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: TJ66513
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: JX51559
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX51559%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for JX51559: 0
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: BA58536
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: DT44623
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44623%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for DT44623: 1
2026-03-30 11:46:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: NW05600
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: FW28464
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW28464%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for FW28464: 1
2026-03-30 11:46:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: HT53317
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT53317%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for HT53317: 1
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: LR48078
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR48078%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for LR48078: 1
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: PL66290
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL66290%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for PL66290: 1
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: LV37866
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LV37866%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for LV37866: 1
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: PS84685
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: WZ45514
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ45514%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for WZ45514: 1
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: AU19337
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: WW90650
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: WN16756
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: PA70218
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA70218%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for PA70218: 1
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: HX60509
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: SB33640
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB33640%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for SB33640: 1
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: EU93857
2026-03-30 11:46:07 [auto1.be] INFO: Found listing with ID: ES88444
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES88444%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Scrape type for ES88444: 2
2026-03-30 11:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09285a63-d977-548e-98c0-3425db0d546e with identifier: ES88444
2026-03-30 11:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09285a63-d977-548e-98c0-3425db0d546e with scrape type 2
2026-03-30 11:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09285a63-d977-548e-98c0-3425db0d546e with scrape type 2
2026-03-30 11:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09285a63-d977-548e-98c0-3425db0d546e, identifier: ES88444
2026-03-30 11:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09285a63-d977-548e-98c0-3425db0d546e with identifier: ES88444
2026-03-30 11:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09285a63-d977-548e-98c0-3425db0d546e with identifier: ES88444
2026-03-30 11:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09285a63-d977-548e-98c0-3425db0d546e with identifier: ES88444 to the API
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:03:32Z',
 'fuel_type': 'diesel',
 'id': '09285a63-d977-548e-98c0-3425db0d546e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES88444',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 139672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-02',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction ultra',
 'transmission': 'manual',
 'trim': 'Attraction ultra',
 'year': 2015}
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES88444%27 HTTP/1.1" 200 None
2026-03-30 11:46:07 [auto1.be] INFO: Saving data for ES88444: {'auction_closing_time': 1774969412.0, 'created_time': 1774298268.976588, 'last_price_update_time': 1774871167.983263}
2026-03-30 11:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES88444') HTTP/1.1" 204 0
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: LP81056
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP81056%27 HTTP/1.1" 200 None
2026-03-30 11:46:08 [auto1.be] INFO: Scrape type for LP81056: 1
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: PT40998
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT40998%27 HTTP/1.1" 200 None
2026-03-30 11:46:08 [auto1.be] INFO: Scrape type for PT40998: 2
2026-03-30 11:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e3f8c8-c4be-55f2-b28c-d3e678701c7e with identifier: PT40998
2026-03-30 11:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e3f8c8-c4be-55f2-b28c-d3e678701c7e with scrape type 2
2026-03-30 11:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43e3f8c8-c4be-55f2-b28c-d3e678701c7e with scrape type 2
2026-03-30 11:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43e3f8c8-c4be-55f2-b28c-d3e678701c7e, identifier: PT40998
2026-03-30 11:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43e3f8c8-c4be-55f2-b28c-d3e678701c7e with identifier: PT40998
2026-03-30 11:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43e3f8c8-c4be-55f2-b28c-d3e678701c7e with identifier: PT40998
2026-03-30 11:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43e3f8c8-c4be-55f2-b28c-d3e678701c7e with identifier: PT40998 to the API
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:36:03Z',
 'fuel_type': 'petrol',
 'id': '43e3f8c8-c4be-55f2-b28c-d3e678701c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT40998',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 97722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT40998%27 HTTP/1.1" 200 None
2026-03-30 11:46:08 [auto1.be] INFO: Saving data for PT40998: {'auction_closing_time': 1774971363.0, 'created_time': 1774298352.850764, 'last_price_update_time': 1774871168.551844}
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PT40998') HTTP/1.1" 204 0
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: RN29378
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: EB14047
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: WG16192
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: GZ79975
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: ZG35997
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: PV60637
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: LP17149
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP17149%27 HTTP/1.1" 200 None
2026-03-30 11:46:08 [auto1.be] INFO: Scrape type for LP17149: 1
2026-03-30 11:46:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.126(s), this was the 2nd time calling it.
2026-03-30 11:46:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.072050453639401 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: PD12603
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD12603%27 HTTP/1.1" 200 None
2026-03-30 11:46:08 [auto1.be] INFO: Scrape type for PD12603: 1
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: FF72593
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: MW08059
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW08059%27 HTTP/1.1" 200 None
2026-03-30 11:46:08 [auto1.be] INFO: Scrape type for MW08059: 1
2026-03-30 11:46:08 [auto1.be] INFO: Found listing with ID: RV85346
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV85346%27 HTTP/1.1" 200 None
2026-03-30 11:46:08 [auto1.be] INFO: Scrape type for RV85346: 2
2026-03-30 11:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f2efd6-31e0-57f3-b29a-0b405609d12f with identifier: RV85346
2026-03-30 11:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f2efd6-31e0-57f3-b29a-0b405609d12f with scrape type 2
2026-03-30 11:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f2efd6-31e0-57f3-b29a-0b405609d12f with scrape type 2
2026-03-30 11:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6f2efd6-31e0-57f3-b29a-0b405609d12f, identifier: RV85346
2026-03-30 11:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6f2efd6-31e0-57f3-b29a-0b405609d12f with identifier: RV85346
2026-03-30 11:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6f2efd6-31e0-57f3-b29a-0b405609d12f with identifier: RV85346
2026-03-30 11:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6f2efd6-31e0-57f3-b29a-0b405609d12f with identifier: RV85346 to the API
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:08:15Z',
 'fuel_type': 'petrol',
 'id': 'c6f2efd6-31e0-57f3-b29a-0b405609d12f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV85346',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 121924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-10',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 11:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV85346%27 HTTP/1.1" 200 None
2026-03-30 11:46:09 [auto1.be] INFO: Saving data for RV85346: {'auction_closing_time': 1774969695.0, 'created_time': 1774298201.52435, 'last_price_update_time': 1774871169.104945}
2026-03-30 11:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RV85346') HTTP/1.1" 204 0
2026-03-30 11:46:09 [auto1.be] INFO: Found listing with ID: KM33762
2026-03-30 11:46:09 [auto1.be] INFO: Found listing with ID: SC48774
2026-03-30 11:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC48774%27 HTTP/1.1" 200 None
2026-03-30 11:46:09 [auto1.be] INFO: Scrape type for SC48774: 1
2026-03-30 11:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:10 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1764 | hits on page: 40
2026-03-30 11:46:10 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-30 11:46:10 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-30 11:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-30 11:46:10 [auto1.be] INFO: Scrape type for YB46987: 2
2026-03-30 11:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987
2026-03-30 11:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d764ff5f-2957-538b-8342-eef22b8c96b0 with scrape type 2
2026-03-30 11:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d764ff5f-2957-538b-8342-eef22b8c96b0 with scrape type 2
2026-03-30 11:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d764ff5f-2957-538b-8342-eef22b8c96b0, identifier: YB46987
2026-03-30 11:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987
2026-03-30 11:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987
2026-03-30 11:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d764ff5f-2957-538b-8342-eef22b8c96b0 with identifier: YB46987 to the API
2026-03-30 11:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:21:38Z',
 'fuel_type': 'diesel',
 'id': 'd764ff5f-2957-538b-8342-eef22b8c96b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB46987',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 159882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Saving data for YB46987: {'auction_closing_time': 1774970498.0, 'created_time': 1773137045.358787, 'last_price_update_time': 1774871171.162053}
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB46987') HTTP/1.1" 204 0
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: ZN07894
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: LM52294
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: ST95230
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST95230%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for ST95230: 1
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: AL22042
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: FN89507
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: EK78236
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: WC26053
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: HW43173
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW43173%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for HW43173: 1
2026-03-30 11:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV32890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: LD88636
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: WK88791
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK88791%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for WK88791: 1
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: SY31079
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: XK60996
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK60996%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for XK60996: 1
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: EY10486
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: ZH36380
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: XD24898
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: ES37809
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: BP63319
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP63319%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for BP63319: 1
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: PJ76260
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ76260%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for PJ76260: 2
2026-03-30 11:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be7a7c6d-2f96-50c0-ab2b-74f873392b5b with identifier: PJ76260
2026-03-30 11:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be7a7c6d-2f96-50c0-ab2b-74f873392b5b with scrape type 2
2026-03-30 11:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be7a7c6d-2f96-50c0-ab2b-74f873392b5b with scrape type 2
2026-03-30 11:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: be7a7c6d-2f96-50c0-ab2b-74f873392b5b, identifier: PJ76260
2026-03-30 11:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: be7a7c6d-2f96-50c0-ab2b-74f873392b5b with identifier: PJ76260
2026-03-30 11:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: be7a7c6d-2f96-50c0-ab2b-74f873392b5b with identifier: PJ76260
2026-03-30 11:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: be7a7c6d-2f96-50c0-ab2b-74f873392b5b with identifier: PJ76260 to the API
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-31T15:12:01Z',
 'fuel_type': 'petrol',
 'id': 'be7a7c6d-2f96-50c0-ab2b-74f873392b5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ76260',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 53473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-21',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Oasis',
 'transmission': 'automatic',
 'trim': 'Oasis',
 'year': 2003}
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ76260%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Saving data for PJ76260: {'auction_closing_time': 1774969921.0, 'created_time': 1774298322.880051, 'last_price_update_time': 1774871171.748682}
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ76260') HTTP/1.1" 204 0
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: XD22727
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD22727%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for XD22727: 1
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: SM25076
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: SW30540
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: EV96018
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: VC77463
2026-03-30 11:46:11 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-30 11:46:11 [auto1.be] INFO: Scrape type for AM99393: 2
2026-03-30 11:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393
2026-03-30 11:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with scrape type 2
2026-03-30 11:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with scrape type 2
2026-03-30 11:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3, identifier: AM99393
2026-03-30 11:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393
2026-03-30 11:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393
2026-03-30 11:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c90fb8a8-91a1-54dd-8974-52c2bc22dbf3 with identifier: AM99393 to the API
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:56:28Z',
 'fuel_type': 'petrol',
 'id': 'c90fb8a8-91a1-54dd-8974-52c2bc22dbf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM99393',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 150170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-03',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2013}
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-30 11:46:12 [auto1.be] INFO: Saving data for AM99393: {'auction_closing_time': 1774972588.0, 'created_time': 1773384664.798402, 'last_price_update_time': 1774871172.305404}
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM99393') HTTP/1.1" 204 0
2026-03-30 11:46:12 [auto1.be] INFO: Found listing with ID: LX71695
2026-03-30 11:46:12 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-30 11:46:12 [auto1.be] INFO: Scrape type for GW87029: 2
2026-03-30 11:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029
2026-03-30 11:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a898b5b6-3de7-58d7-b50e-7e0904bf66ed with scrape type 2
2026-03-30 11:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a898b5b6-3de7-58d7-b50e-7e0904bf66ed with scrape type 2
2026-03-30 11:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a898b5b6-3de7-58d7-b50e-7e0904bf66ed, identifier: GW87029
2026-03-30 11:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029
2026-03-30 11:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029
2026-03-30 11:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029 to the API
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:22:55Z',
 'fuel_type': 'petrol',
 'id': 'a898b5b6-3de7-58d7-b50e-7e0904bf66ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW87029',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 95802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-12',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2007}
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-30 11:46:12 [auto1.be] INFO: Saving data for GW87029: {'auction_closing_time': 1774970575.0, 'created_time': 1774514146.988463, 'last_price_update_time': 1774871172.773302}
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW87029') HTTP/1.1" 204 0
2026-03-30 11:46:12 [auto1.be] INFO: Found listing with ID: TS39251
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS39251%27 HTTP/1.1" 200 None
2026-03-30 11:46:12 [auto1.be] INFO: Scrape type for TS39251: 1
2026-03-30 11:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW28464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:12 [auto1.be] INFO: Found listing with ID: SG06141
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG06141%27 HTTP/1.1" 200 None
2026-03-30 11:46:12 [auto1.be] INFO: Scrape type for SG06141: 1
2026-03-30 11:46:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:12 [auto1.be] INFO: Found listing with ID: GH31708
2026-03-30 11:46:12 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-30 11:46:12 [auto1.be] INFO: Scrape type for AX27110: 2
2026-03-30 11:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110
2026-03-30 11:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d2589a-531d-5ce5-ae01-0452f8a156ec with scrape type 2
2026-03-30 11:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0d2589a-531d-5ce5-ae01-0452f8a156ec with scrape type 2
2026-03-30 11:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0d2589a-531d-5ce5-ae01-0452f8a156ec, identifier: AX27110
2026-03-30 11:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110
2026-03-30 11:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110
2026-03-30 11:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0d2589a-531d-5ce5-ae01-0452f8a156ec with identifier: AX27110 to the API
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:23:31Z',
 'fuel_type': 'diesel',
 'id': 'c0d2589a-531d-5ce5-ae01-0452f8a156ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX27110',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 116071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-30 11:46:13 [auto1.be] INFO: Saving data for AX27110: {'auction_closing_time': 1774970611.0, 'created_time': 1773136938.13352, 'last_price_update_time': 1774871173.281769}
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX27110') HTTP/1.1" 204 0
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: FK55649
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: XS95639
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: MK43938
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK43938%27 HTTP/1.1" 200 None
2026-03-30 11:46:13 [auto1.be] INFO: Scrape type for MK43938: 1
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: CL15849
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL15849%27 HTTP/1.1" 200 None
2026-03-30 11:46:13 [auto1.be] INFO: Scrape type for CL15849: 1
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-30 11:46:13 [auto1.be] INFO: Scrape type for YN92139: 2
2026-03-30 11:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139
2026-03-30 11:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with scrape type 2
2026-03-30 11:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with scrape type 2
2026-03-30 11:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb, identifier: YN92139
2026-03-30 11:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139
2026-03-30 11:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139
2026-03-30 11:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb with identifier: YN92139 to the API
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:04:11Z',
 'fuel_type': 'diesel',
 'id': 'f3b3dcab-c3fb-5ee8-befe-a6fa888fcceb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN92139',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 185112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-17',
 'seller_name': None,
 'title': 'Skoda Roomster 1.4 TDI Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-30 11:46:13 [auto1.be] INFO: Saving data for YN92139: {'auction_closing_time': 1774969451.0, 'created_time': 1773301643.434219, 'last_price_update_time': 1774871173.924904}
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN92139') HTTP/1.1" 204 0
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: GA37165
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: JH66353
2026-03-30 11:46:13 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-30 11:46:13 [auto1.be] INFO: Scrape type for HJ27727: 2
2026-03-30 11:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727
2026-03-30 11:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecd06346-9e38-511a-9814-a315edae3dcc with scrape type 2
2026-03-30 11:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecd06346-9e38-511a-9814-a315edae3dcc with scrape type 2
2026-03-30 11:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ecd06346-9e38-511a-9814-a315edae3dcc, identifier: HJ27727
2026-03-30 11:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727
2026-03-30 11:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727
2026-03-30 11:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ecd06346-9e38-511a-9814-a315edae3dcc with identifier: HJ27727 to the API
2026-03-30 11:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:52:40Z',
 'fuel_type': 'petrol',
 'id': 'ecd06346-9e38-511a-9814-a315edae3dcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ27727',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 128930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seller_name': None,
 'title': 'Volvo V40 1.5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2019}
2026-03-30 11:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-30 11:46:14 [auto1.be] INFO: Saving data for HJ27727: {'auction_closing_time': 1774972360.0, 'created_time': 1773136924.245805, 'last_price_update_time': 1774871174.374506}
2026-03-30 11:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ27727') HTTP/1.1" 204 0
2026-03-30 11:46:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT44623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT53317/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.179(s), this was the 2nd time calling it.
2026-03-30 11:46:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.388671291747782 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR48078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP52428> (referer: https://www.auto1.com/v1/car-details-view/XP52428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56250f00-fe1e-5ee9-af30-ad8db41906ec with identifier: XP52428
2026-03-30 11:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56250f00-fe1e-5ee9-af30-ad8db41906ec with scrape type 1
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_cce8d2bd133a3d0ab753816f4ec6fcae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_cce8d2bd133a3d0ab753816f4ec6fcae.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_a9de4b007e70eb34800b2f0bbdbe050b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_a9de4b007e70eb34800b2f0bbdbe050b.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_e1e2ea608f20da9cb81aa2aaeb97cd99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_e1e2ea608f20da9cb81aa2aaeb97cd99.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_3658fb1bb0e3c4a7dd7de8b102aff712.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_3658fb1bb0e3c4a7dd7de8b102aff712.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_63d40706e58c2c38f3cb5310163395f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_63d40706e58c2c38f3cb5310163395f8.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_6fcfa151c51327aa0e5fff49a073cd76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_6fcfa151c51327aa0e5fff49a073cd76.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_7ab1eb6ebd7024d30c30fa7322d8284f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7ab1eb6ebd7024d30c30fa7322d8284f.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_7a4f74eefd3531c30c7931fdc0e7da69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7a4f74eefd3531c30c7931fdc0e7da69.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_327933083b9d760ed92c87cf0e98cf75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_327933083b9d760ed92c87cf0e98cf75.jpg not downloaded yet
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_5c6186717cfe17393c073672964e2b7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_5c6186717cfe17393c073672964e2b7a.jpg not downloaded yet
2026-03-30 11:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV37866/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_5c6186717cfe17393c073672964e2b7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca50a10>
2026-03-30 11:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_5c6186717cfe17393c073672964e2b7a.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_5c6186717cfe17393c073672964e2b7a.jpg saved to cache
2026-03-30 11:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB33640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_327933083b9d760ed92c87cf0e98cf75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71e450>
2026-03-30 11:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_327933083b9d760ed92c87cf0e98cf75.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_327933083b9d760ed92c87cf0e98cf75.jpg saved to cache
2026-03-30 11:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL66290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7a4f74eefd3531c30c7931fdc0e7da69.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca521d0>
2026-03-30 11:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_7a4f74eefd3531c30c7931fdc0e7da69.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7a4f74eefd3531c30c7931fdc0e7da69.jpg saved to cache
2026-03-30 11:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC48774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7ab1eb6ebd7024d30c30fa7322d8284f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994850>
2026-03-30 11:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_7ab1eb6ebd7024d30c30fa7322d8284f.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7ab1eb6ebd7024d30c30fa7322d8284f.jpg saved to cache
2026-03-30 11:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.720(s), this was the 1st time calling it.
2026-03-30 11:46:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.5193543634113342 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT85066> (referer: https://www.auto1.com/v1/car-details-view/HT85066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02d543a-d7d1-59b9-b0db-393ffb33122b with identifier: HT85066
2026-03-30 11:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02d543a-d7d1-59b9-b0db-393ffb33122b with scrape type 1
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_7b2bcb1273f9b898b7c61fd5fe264942.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_7b2bcb1273f9b898b7c61fd5fe264942.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_263f4b902d7794a042f76dcf8f004477.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_263f4b902d7794a042f76dcf8f004477.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_29c83ec02842610f2cbd898a2c903985.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_29c83ec02842610f2cbd898a2c903985.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_c9d8949b9ee16d6242b8d1ae272d511b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_c9d8949b9ee16d6242b8d1ae272d511b.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_f503e97f92e485554793b6b46120f0f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_f503e97f92e485554793b6b46120f0f0.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_a11e6ad8874bddcf73e7698ec209c6b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_a11e6ad8874bddcf73e7698ec209c6b7.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_0342d403756098941b51ee35d2212d58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0342d403756098941b51ee35d2212d58.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_0be50fe7280196e23907dfb8887e7208.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0be50fe7280196e23907dfb8887e7208.jpg not downloaded yet
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_bac757da7cbe8c01f8fbb94e17db5795.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_bac757da7cbe8c01f8fbb94e17db5795.jpg not downloaded yet
2026-03-30 11:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_6fcfa151c51327aa0e5fff49a073cd76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_815b423de37a3021ba5d8aef31da3ff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_815b423de37a3021ba5d8aef31da3ff9.jpg not downloaded yet
2026-03-30 11:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b9550>
2026-03-30 11:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_6fcfa151c51327aa0e5fff49a073cd76.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_6fcfa151c51327aa0e5fff49a073cd76.jpg saved to cache
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0be50fe7280196e23907dfb8887e7208.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5ce050>
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_0be50fe7280196e23907dfb8887e7208.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0be50fe7280196e23907dfb8887e7208.jpg saved to cache
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_815b423de37a3021ba5d8aef31da3ff9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_bac757da7cbe8c01f8fbb94e17db5795.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc866750>
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_815b423de37a3021ba5d8aef31da3ff9.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_815b423de37a3021ba5d8aef31da3ff9.jpg saved to cache
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0342d403756098941b51ee35d2212d58.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9958d0>
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_bac757da7cbe8c01f8fbb94e17db5795.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_bac757da7cbe8c01f8fbb94e17db5795.jpg saved to cache
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_a11e6ad8874bddcf73e7698ec209c6b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc922290>
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_0342d403756098941b51ee35d2212d58.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0342d403756098941b51ee35d2212d58.jpg saved to cache
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc74e350>
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_a11e6ad8874bddcf73e7698ec209c6b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_a11e6ad8874bddcf73e7698ec209c6b7.jpg saved to cache
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_f503e97f92e485554793b6b46120f0f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcaa1d90>
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_f503e97f92e485554793b6b46120f0f0.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_f503e97f92e485554793b6b46120f0f0.jpg saved to cache
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_c9d8949b9ee16d6242b8d1ae272d511b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75e350>
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_c9d8949b9ee16d6242b8d1ae272d511b.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_c9d8949b9ee16d6242b8d1ae272d511b.jpg saved to cache
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_29c83ec02842610f2cbd898a2c903985.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994f50>
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_29c83ec02842610f2cbd898a2c903985.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_29c83ec02842610f2cbd898a2c903985.jpg saved to cache
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_263f4b902d7794a042f76dcf8f004477.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST95230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_7b2bcb1273f9b898b7c61fd5fe264942.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7263d0>
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_263f4b902d7794a042f76dcf8f004477.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_263f4b902d7794a042f76dcf8f004477.jpg saved to cache
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca43a90>
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F43%252F69438d4820bf5345c535ff0af0a9a1cd%252Fpa%252FHT85066_7b2bcb1273f9b898b7c61fd5fe264942.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_7b2bcb1273f9b898b7c61fd5fe264942.jpg saved to cache
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a02d543a-d7d1-59b9-b0db-393ffb33122b
2026-03-30 11:46:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a02d543a-d7d1-59b9-b0db-393ffb33122b, skipping ID generation
2026-03-30 11:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02d543a-d7d1-59b9-b0db-393ffb33122b with scrape type 1
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a02d543a-d7d1-59b9-b0db-393ffb33122b sending to next pipeline
2026-03-30 11:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a02d543a-d7d1-59b9-b0db-393ffb33122b, identifier: HT85066
2026-03-30 11:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a02d543a-d7d1-59b9-b0db-393ffb33122b with identifier: HT85066
2026-03-30 11:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a02d543a-d7d1-59b9-b0db-393ffb33122b with identifier: HT85066
2026-03-30 11:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a02d543a-d7d1-59b9-b0db-393ffb33122b with identifier: HT85066 to the API
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_7b2bcb1273f9b898b7c61fd5fe264942.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:58:25Z',
 'fuel_type': 'petrol',
 'id': 'a02d543a-d7d1-59b9-b0db-393ffb33122b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT85066',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 124050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_7b2bcb1273f9b898b7c61fd5fe264942.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_263f4b902d7794a042f76dcf8f004477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_29c83ec02842610f2cbd898a2c903985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_c9d8949b9ee16d6242b8d1ae272d511b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_f503e97f92e485554793b6b46120f0f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_a11e6ad8874bddcf73e7698ec209c6b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0342d403756098941b51ee35d2212d58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_0be50fe7280196e23907dfb8887e7208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_bac757da7cbe8c01f8fbb94e17db5795.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d543a-d7d1-59b9-b0db-393ffb33122b/a02d543a-d7d1-59b9-b0db-393ffb33122b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/43/69438d4820bf5345c535ff0af0a9a1cd/pa/HT85066_815b423de37a3021ba5d8aef31da3ff9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace P200 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2019}
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT85066%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Saving data for HT85066: {'created_time': 1774871200.970587, 'last_price_update_time': 1774871200.970598, 'auction_closing_time': 1774972705.0}
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT85066') HTTP/1.1" 204 0
2026-03-30 11:46:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_63d40706e58c2c38f3cb5310163395f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_3658fb1bb0e3c4a7dd7de8b102aff712.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc768450>
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_63d40706e58c2c38f3cb5310163395f8.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_63d40706e58c2c38f3cb5310163395f8.jpg saved to cache
2026-03-30 11:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994a10>
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_3658fb1bb0e3c4a7dd7de8b102aff712.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_3658fb1bb0e3c4a7dd7de8b102aff712.jpg saved to cache
2026-03-30 11:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_e1e2ea608f20da9cb81aa2aaeb97cd99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c3dd0>
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_e1e2ea608f20da9cb81aa2aaeb97cd99.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_e1e2ea608f20da9cb81aa2aaeb97cd99.jpg saved to cache
2026-03-30 11:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_a9de4b007e70eb34800b2f0bbdbe050b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_cce8d2bd133a3d0ab753816f4ec6fcae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc74fed0>
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_a9de4b007e70eb34800b2f0bbdbe050b.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_a9de4b007e70eb34800b2f0bbdbe050b.jpg saved to cache
2026-03-30 11:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca56410>
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F94%252F9394deb7a5a8a42a7adfc85fb26d22ba%252Fpa%252FXP52428_cce8d2bd133a3d0ab753816f4ec6fcae.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_cce8d2bd133a3d0ab753816f4ec6fcae.jpg saved to cache
2026-03-30 11:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56250f00-fe1e-5ee9-af30-ad8db41906ec
2026-03-30 11:46:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56250f00-fe1e-5ee9-af30-ad8db41906ec, skipping ID generation
2026-03-30 11:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56250f00-fe1e-5ee9-af30-ad8db41906ec with scrape type 1
2026-03-30 11:46:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56250f00-fe1e-5ee9-af30-ad8db41906ec sending to next pipeline
2026-03-30 11:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56250f00-fe1e-5ee9-af30-ad8db41906ec, identifier: XP52428
2026-03-30 11:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56250f00-fe1e-5ee9-af30-ad8db41906ec with identifier: XP52428
2026-03-30 11:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56250f00-fe1e-5ee9-af30-ad8db41906ec with identifier: XP52428
2026-03-30 11:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56250f00-fe1e-5ee9-af30-ad8db41906ec with identifier: XP52428 to the API
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_cce8d2bd133a3d0ab753816f4ec6fcae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:06:50Z',
 'fuel_type': 'diesel',
 'id': '56250f00-fe1e-5ee9-af30-ad8db41906ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP52428',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 269125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_cce8d2bd133a3d0ab753816f4ec6fcae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_a9de4b007e70eb34800b2f0bbdbe050b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_e1e2ea608f20da9cb81aa2aaeb97cd99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_3658fb1bb0e3c4a7dd7de8b102aff712.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_63d40706e58c2c38f3cb5310163395f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_6fcfa151c51327aa0e5fff49a073cd76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7ab1eb6ebd7024d30c30fa7322d8284f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_7a4f74eefd3531c30c7931fdc0e7da69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_327933083b9d760ed92c87cf0e98cf75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56250f00-fe1e-5ee9-af30-ad8db41906ec/56250f00-fe1e-5ee9-af30-ad8db41906ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img93/94/9394deb7a5a8a42a7adfc85fb26d22ba/pa/XP52428_5c6186717cfe17393c073672964e2b7a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 HSE',
 'transmission': 'automatic',
 'trim': 'TDV6 HSE',
 'year': 2010}
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP52428%27 HTTP/1.1" 200 None
2026-03-30 11:46:42 [auto1.be] INFO: Saving data for XP52428: {'created_time': 1774871202.597592, 'last_price_update_time': 1774871202.597602, 'auction_closing_time': 1774969610.0}
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XP52428') HTTP/1.1" 204 0
2026-03-30 11:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL15849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP37607> (referer: https://www.auto1.com/v1/car-details-view/KP37607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37da1e98-6caf-52c7-bd44-2d3c0acb15f0 with identifier: KP37607
2026-03-30 11:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37da1e98-6caf-52c7-bd44-2d3c0acb15f0 with scrape type 1
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37da1e98-6caf-52c7-bd44-2d3c0acb15f0
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_538d082a0de301260c43256d4aedee33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_538d082a0de301260c43256d4aedee33.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_0e3d068c13fd8f9a575ef159a57c0217.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_0e3d068c13fd8f9a575ef159a57c0217.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_3c58991d195769c1d1929082bef5a77d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_3c58991d195769c1d1929082bef5a77d.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_0e1e45be7fd009cdf6be270d4c0d7e9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_0e1e45be7fd009cdf6be270d4c0d7e9f.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_870de0c27396e65bc833ed4caefb9d5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_870de0c27396e65bc833ed4caefb9d5e.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_523d60271dfb7896092b4a1080e6bc96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_523d60271dfb7896092b4a1080e6bc96.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_661dfa0dd2f185e4b736ce96312d01d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_661dfa0dd2f185e4b736ce96312d01d4.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_424ad9271c696caaf75b8c2495e84971.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_424ad9271c696caaf75b8c2495e84971.jpg already downloaded
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_1c9389a15ebaaacf744b079b9d6d308a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_1c9389a15ebaaacf744b079b9d6d308a.jpg already downloaded
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F1d%252F621d48834373e211ede0622a68d7cb50%252Fpa%252FKP37607_546ed1ae376764526c30ca0c9331e062.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_546ed1ae376764526c30ca0c9331e062.jpg already downloaded
2026-03-30 11:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 37da1e98-6caf-52c7-bd44-2d3c0acb15f0, identifier: KP37607
2026-03-30 11:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 37da1e98-6caf-52c7-bd44-2d3c0acb15f0 with identifier: KP37607
2026-03-30 11:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 37da1e98-6caf-52c7-bd44-2d3c0acb15f0 with identifier: KP37607
2026-03-30 11:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 37da1e98-6caf-52c7-bd44-2d3c0acb15f0 with identifier: KP37607 to the API
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP37607>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:21:54Z',
 'fuel_type': 'diesel',
 'id': '37da1e98-6caf-52c7-bd44-2d3c0acb15f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP37607',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 71320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_538d082a0de301260c43256d4aedee33.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_0e3d068c13fd8f9a575ef159a57c0217.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_3c58991d195769c1d1929082bef5a77d.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_0e1e45be7fd009cdf6be270d4c0d7e9f.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_870de0c27396e65bc833ed4caefb9d5e.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_523d60271dfb7896092b4a1080e6bc96.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_661dfa0dd2f185e4b736ce96312d01d4.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_424ad9271c696caaf75b8c2495e84971.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_1c9389a15ebaaacf744b079b9d6d308a.jpg',
                'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_546ed1ae376764526c30ca0c9331e062.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_538d082a0de301260c43256d4aedee33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353429,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_0e3d068c13fd8f9a575ef159a57c0217.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_3c58991d195769c1d1929082bef5a77d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_0e1e45be7fd009cdf6be270d4c0d7e9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291548,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_870de0c27396e65bc833ed4caefb9d5e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292934,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_523d60271dfb7896092b4a1080e6bc96.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322646,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_661dfa0dd2f185e4b736ce96312d01d4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_424ad9271c696caaf75b8c2495e84971.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325795,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_1c9389a15ebaaacf744b079b9d6d308a.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37da1e98-6caf-52c7-bd44-2d3c0acb15f0/37da1e98-6caf-52c7-bd44-2d3c0acb15f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313353,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img62/1d/621d48834373e211ede0622a68d7cb50/pa/KP37607_546ed1ae376764526c30ca0c9331e062.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP37607%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [auto1.be] INFO: Saving data for KP37607: {'created_time': 1774871204.425358, 'last_price_update_time': 1774871204.425368, 'auction_closing_time': 1774970514.0}
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP37607') HTTP/1.1" 204 0
2026-03-30 11:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT44623> (referer: https://www.auto1.com/v1/car-details-view/DT44623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT53317> (referer: https://www.auto1.com/v1/car-details-view/HT53317/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32f9d16-fba1-5984-9909-1804bdb63f16 with identifier: DT44623
2026-03-30 11:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32f9d16-fba1-5984-9909-1804bdb63f16 with scrape type 1
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_8a669d979e176d2658147f8866e352bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_8a669d979e176d2658147f8866e352bb.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_dac902bc1668f6be772636f96c48e7d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_dac902bc1668f6be772636f96c48e7d8.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_ce93a583602b801d38bbc71c08e17e2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_ce93a583602b801d38bbc71c08e17e2b.jpg not downloaded yet
2026-03-30 11:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3190d75-0c38-5aed-8a4f-5fa032f225ff with identifier: HT53317
2026-03-30 11:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3190d75-0c38-5aed-8a4f-5fa032f225ff with scrape type 1
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_b5db23a9edbaa4263250089488a3c317.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b5db23a9edbaa4263250089488a3c317.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_9dc76a3afa615c4712f8084da8e3ef5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_9dc76a3afa615c4712f8084da8e3ef5b.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_b0b28e3dfe0ce65a4e8bf9f140ac0ea1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b0b28e3dfe0ce65a4e8bf9f140ac0ea1.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_7131df1a8c23b02fb7a2dd3d1a497f5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7131df1a8c23b02fb7a2dd3d1a497f5a.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_62fc669a5d3dc0bfca87fe78760431c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_62fc669a5d3dc0bfca87fe78760431c7.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_7ca1f8203375982a3adce1a4e975d8bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7ca1f8203375982a3adce1a4e975d8bc.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_bb6f571c65b2a8962ec25c7afc32a3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_bb6f571c65b2a8962ec25c7afc32a3ac.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_bd5f4ef2a6bd5a09902761a9ff8c55c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_bd5f4ef2a6bd5a09902761a9ff8c55c1.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_040685538fb451a8b08aad657ce272b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_040685538fb451a8b08aad657ce272b7.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_fdf900d04391e17297eba1f59deb26b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_fdf900d04391e17297eba1f59deb26b0.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_af8810d7f45cd6a5eef121aaad1df9a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_af8810d7f45cd6a5eef121aaad1df9a6.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_48179d329b8e8f1c389add8b2b5fc21d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_48179d329b8e8f1c389add8b2b5fc21d.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_c6bffbe377028adf7a38172b588ace7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_c6bffbe377028adf7a38172b588ace7b.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_11307dd1345ba85613d7fbeaa79cd720.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_11307dd1345ba85613d7fbeaa79cd720.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_4d43c514bb375041e46c22e1a3b4f24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_4d43c514bb375041e46c22e1a3b4f24d.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_f6dbc3de0afb9ce095f90ebe22393341.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_f6dbc3de0afb9ce095f90ebe22393341.jpg not downloaded yet
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_a810cf5172ca83019546f325a03895cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_a810cf5172ca83019546f325a03895cf.jpg not downloaded yet
2026-03-30 11:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB33640> (referer: https://www.auto1.com/v1/car-details-view/SB33640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25 with identifier: SB33640
2026-03-30 11:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25 with scrape type 1
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_9b11092d7bbf8b87fba9aa002c197cc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_9b11092d7bbf8b87fba9aa002c197cc8.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_032f353a0b97381a71ea973d5f36c183.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_032f353a0b97381a71ea973d5f36c183.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_f52b34511b71904866337885b7dc49f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_f52b34511b71904866337885b7dc49f5.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_47ae17c72ae94718911ea490e155cfd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_47ae17c72ae94718911ea490e155cfd7.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_a06a9b76c8e7d770c84d3950eb9965a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_a06a9b76c8e7d770c84d3950eb9965a9.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_5a9e972fa6112c0491e089d4e9fffd57.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_5a9e972fa6112c0491e089d4e9fffd57.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_2d9015cbcfce9d624e599ee0497c606d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_2d9015cbcfce9d624e599ee0497c606d.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_e360acff7be81804210ecc8036ee71fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_e360acff7be81804210ecc8036ee71fb.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_fcb2c2fe5f71def5321988b0b683cef9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_fcb2c2fe5f71def5321988b0b683cef9.jpg already downloaded
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F0b%252F400b2c317071e606eb1e180254134abe%252Fpa%252FSB33640_388f70462297554ed888a1fd375720e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_388f70462297554ed888a1fd375720e4.jpg already downloaded
2026-03-30 11:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25, identifier: SB33640
2026-03-30 11:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25 with identifier: SB33640
2026-03-30 11:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25 with identifier: SB33640
2026-03-30 11:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25 with identifier: SB33640 to the API
2026-03-30 11:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB33640>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-03-31T15:17:54Z',
 'fuel_type': 'hybrid',
 'id': '3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB33640',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 89139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_9b11092d7bbf8b87fba9aa002c197cc8.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_032f353a0b97381a71ea973d5f36c183.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_f52b34511b71904866337885b7dc49f5.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_47ae17c72ae94718911ea490e155cfd7.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_a06a9b76c8e7d770c84d3950eb9965a9.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_5a9e972fa6112c0491e089d4e9fffd57.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_2d9015cbcfce9d624e599ee0497c606d.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_e360acff7be81804210ecc8036ee71fb.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_fcb2c2fe5f71def5321988b0b683cef9.jpg',
                'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_388f70462297554ed888a1fd375720e4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_9b11092d7bbf8b87fba9aa002c197cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_032f353a0b97381a71ea973d5f36c183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_f52b34511b71904866337885b7dc49f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_47ae17c72ae94718911ea490e155cfd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_a06a9b76c8e7d770c84d3950eb9965a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_5a9e972fa6112c0491e089d4e9fffd57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_2d9015cbcfce9d624e599ee0497c606d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_e360acff7be81804210ecc8036ee71fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_fcb2c2fe5f71def5321988b0b683cef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25/3bda7a24-4217-59e4-b6f2-9f8d5d3c4e25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/0b/400b2c317071e606eb1e180254134abe/pa/SB33640_388f70462297554ed888a1fd375720e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB33640%27 HTTP/1.1" 200 None
2026-03-30 11:46:47 [auto1.be] INFO: Saving data for SB33640: {'created_time': 1774871207.152072, 'last_price_update_time': 1774871207.152083, 'auction_closing_time': 1774970274.0}
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB33640') HTTP/1.1" 204 0
2026-03-30 11:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_a810cf5172ca83019546f325a03895cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc89cf90>
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_a810cf5172ca83019546f325a03895cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_a810cf5172ca83019546f325a03895cf.jpg saved to cache
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_f6dbc3de0afb9ce095f90ebe22393341.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc935e90>
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_f6dbc3de0afb9ce095f90ebe22393341.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_f6dbc3de0afb9ce095f90ebe22393341.jpg saved to cache
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_4d43c514bb375041e46c22e1a3b4f24d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_11307dd1345ba85613d7fbeaa79cd720.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcaa2910>
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_4d43c514bb375041e46c22e1a3b4f24d.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_4d43c514bb375041e46c22e1a3b4f24d.jpg saved to cache
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71dad0>
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_11307dd1345ba85613d7fbeaa79cd720.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_11307dd1345ba85613d7fbeaa79cd720.jpg saved to cache
2026-03-30 11:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_c6bffbe377028adf7a38172b588ace7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_48179d329b8e8f1c389add8b2b5fc21d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b8410>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_c6bffbe377028adf7a38172b588ace7b.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_c6bffbe377028adf7a38172b588ace7b.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc89ca90>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_48179d329b8e8f1c389add8b2b5fc21d.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_48179d329b8e8f1c389add8b2b5fc21d.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_af8810d7f45cd6a5eef121aaad1df9a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL66290> (referer: https://www.auto1.com/v1/car-details-view/PL66290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc93ae10>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_af8810d7f45cd6a5eef121aaad1df9a6.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_af8810d7f45cd6a5eef121aaad1df9a6.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ec1c47-28e1-500a-841a-3c2bd49dbe38 with identifier: PL66290
2026-03-30 11:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38 with scrape type 1
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_7d67bbe952b23f0c96043e98f45b59e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7d67bbe952b23f0c96043e98f45b59e1.jpg not downloaded yet
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_fdf900d04391e17297eba1f59deb26b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_a745f7356ac9a828e523caf5a6e33c1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_a745f7356ac9a828e523caf5a6e33c1d.jpg not downloaded yet
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_040685538fb451a8b08aad657ce272b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_549c2a91d20c625b23dd257e4c4e300e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_549c2a91d20c625b23dd257e4c4e300e.jpg not downloaded yet
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_0820c055c1c22870e9dfaa0d5804ab84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0820c055c1c22870e9dfaa0d5804ab84.jpg not downloaded yet
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_e6ed2532fe1f72bbbcccd463e62fbc50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_e6ed2532fe1f72bbbcccd463e62fbc50.jpg not downloaded yet
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_3342cfa029cdaeebd0e5e5a3b1866b6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_3342cfa029cdaeebd0e5e5a3b1866b6b.jpg not downloaded yet
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_d721b0bc0c8defcf2d96bf3e0465a570.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_d721b0bc0c8defcf2d96bf3e0465a570.jpg not downloaded yet
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_a745f7356ac9a828e523caf5a6e33c1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7d67bbe952b23f0c96043e98f45b59e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_0f29327e289db6b87f354747c1584334.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0f29327e289db6b87f354747c1584334.jpg not downloaded yet
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc999690>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_fdf900d04391e17297eba1f59deb26b0.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_fdf900d04391e17297eba1f59deb26b0.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_c550e9565db5e82a189abec963e9fd14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_c550e9565db5e82a189abec963e9fd14.jpg not downloaded yet
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_7ab33a0d06addb1721929aabf037a706.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7ab33a0d06addb1721929aabf037a706.jpg not downloaded yet
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78ae90>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_040685538fb451a8b08aad657ce272b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_040685538fb451a8b08aad657ce272b7.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_d721b0bc0c8defcf2d96bf3e0465a570.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_3342cfa029cdaeebd0e5e5a3b1866b6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6f2c50>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_a745f7356ac9a828e523caf5a6e33c1d.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_a745f7356ac9a828e523caf5a6e33c1d.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc89e2d0>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_7d67bbe952b23f0c96043e98f45b59e1.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7d67bbe952b23f0c96043e98f45b59e1.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7ab33a0d06addb1721929aabf037a706.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc89e3d0>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_d721b0bc0c8defcf2d96bf3e0465a570.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_d721b0bc0c8defcf2d96bf3e0465a570.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_c550e9565db5e82a189abec963e9fd14.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0f29327e289db6b87f354747c1584334.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc855ed0>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_3342cfa029cdaeebd0e5e5a3b1866b6b.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_3342cfa029cdaeebd0e5e5a3b1866b6b.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc997310>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_7ab33a0d06addb1721929aabf037a706.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7ab33a0d06addb1721929aabf037a706.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0820c055c1c22870e9dfaa0d5804ab84.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_e6ed2532fe1f72bbbcccd463e62fbc50.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86e010>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_c550e9565db5e82a189abec963e9fd14.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_c550e9565db5e82a189abec963e9fd14.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f50d0>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_0f29327e289db6b87f354747c1584334.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0f29327e289db6b87f354747c1584334.jpg saved to cache
2026-03-30 11:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_bd5f4ef2a6bd5a09902761a9ff8c55c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_549c2a91d20c625b23dd257e4c4e300e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7a8a90>
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_0820c055c1c22870e9dfaa0d5804ab84.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0820c055c1c22870e9dfaa0d5804ab84.jpg saved to cache
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7ca1f8203375982a3adce1a4e975d8bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75bfd0>
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_e6ed2532fe1f72bbbcccd463e62fbc50.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_e6ed2532fe1f72bbbcccd463e62fbc50.jpg saved to cache
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc89ef10>
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_bd5f4ef2a6bd5a09902761a9ff8c55c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_bd5f4ef2a6bd5a09902761a9ff8c55c1.jpg saved to cache
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc929a90>
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F70%252F14703d82d3232827577d2dc847a4feda%252Fpa%252FPL66290_549c2a91d20c625b23dd257e4c4e300e.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_549c2a91d20c625b23dd257e4c4e300e.jpg saved to cache
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38
2026-03-30 11:46:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98ec1c47-28e1-500a-841a-3c2bd49dbe38, skipping ID generation
2026-03-30 11:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38 with scrape type 1
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98ec1c47-28e1-500a-841a-3c2bd49dbe38 sending to next pipeline
2026-03-30 11:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98ec1c47-28e1-500a-841a-3c2bd49dbe38, identifier: PL66290
2026-03-30 11:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98ec1c47-28e1-500a-841a-3c2bd49dbe38 with identifier: PL66290
2026-03-30 11:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98ec1c47-28e1-500a-841a-3c2bd49dbe38 with identifier: PL66290
2026-03-30 11:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98ec1c47-28e1-500a-841a-3c2bd49dbe38 with identifier: PL66290 to the API
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_549c2a91d20c625b23dd257e4c4e300e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:25Z',
 'fuel_type': 'diesel',
 'id': '98ec1c47-28e1-500a-841a-3c2bd49dbe38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL66290',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 67128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7d67bbe952b23f0c96043e98f45b59e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_a745f7356ac9a828e523caf5a6e33c1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_549c2a91d20c625b23dd257e4c4e300e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0820c055c1c22870e9dfaa0d5804ab84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_e6ed2532fe1f72bbbcccd463e62fbc50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_3342cfa029cdaeebd0e5e5a3b1866b6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_d721b0bc0c8defcf2d96bf3e0465a570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_0f29327e289db6b87f354747c1584334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_c550e9565db5e82a189abec963e9fd14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ec1c47-28e1-500a-841a-3c2bd49dbe38/98ec1c47-28e1-500a-841a-3c2bd49dbe38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/70/14703d82d3232827577d2dc847a4feda/pa/PL66290_7ab33a0d06addb1721929aabf037a706.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL66290%27 HTTP/1.1" 200 None
2026-03-30 11:46:49 [auto1.be] INFO: Saving data for PL66290: {'created_time': 1774871209.869148, 'last_price_update_time': 1774871209.86916, 'auction_closing_time': 1774969465.0}
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL66290') HTTP/1.1" 204 0
2026-03-30 11:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_62fc669a5d3dc0bfca87fe78760431c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA70218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc99b5d0>
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_7ca1f8203375982a3adce1a4e975d8bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7ca1f8203375982a3adce1a4e975d8bc.jpg saved to cache
2026-03-30 11:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_bb6f571c65b2a8962ec25c7afc32a3ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b0e90>
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_62fc669a5d3dc0bfca87fe78760431c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_62fc669a5d3dc0bfca87fe78760431c7.jpg saved to cache
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5d2e90>
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_bb6f571c65b2a8962ec25c7afc32a3ac.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_bb6f571c65b2a8962ec25c7afc32a3ac.jpg saved to cache
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7131df1a8c23b02fb7a2dd3d1a497f5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_9dc76a3afa615c4712f8084da8e3ef5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b0b28e3dfe0ce65a4e8bf9f140ac0ea1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7591d0>
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_7131df1a8c23b02fb7a2dd3d1a497f5a.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7131df1a8c23b02fb7a2dd3d1a497f5a.jpg saved to cache
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d84d0>
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_9dc76a3afa615c4712f8084da8e3ef5b.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_9dc76a3afa615c4712f8084da8e3ef5b.jpg saved to cache
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ac110>
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_b0b28e3dfe0ce65a4e8bf9f140ac0ea1.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b0b28e3dfe0ce65a4e8bf9f140ac0ea1.jpg saved to cache
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_ce93a583602b801d38bbc71c08e17e2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b5db23a9edbaa4263250089488a3c317.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_dac902bc1668f6be772636f96c48e7d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_8a669d979e176d2658147f8866e352bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b16d0>
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_ce93a583602b801d38bbc71c08e17e2b.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_ce93a583602b801d38bbc71c08e17e2b.jpg saved to cache
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7a8190>
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbd%252F63bdb3000e706c762a611c05759f8755%252Fpa%252FHT53317_b5db23a9edbaa4263250089488a3c317.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b5db23a9edbaa4263250089488a3c317.jpg saved to cache
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3190d75-0c38-5aed-8a4f-5fa032f225ff
2026-03-30 11:46:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3190d75-0c38-5aed-8a4f-5fa032f225ff, skipping ID generation
2026-03-30 11:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3190d75-0c38-5aed-8a4f-5fa032f225ff with scrape type 1
2026-03-30 11:46:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3190d75-0c38-5aed-8a4f-5fa032f225ff sending to next pipeline
2026-03-30 11:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3190d75-0c38-5aed-8a4f-5fa032f225ff, identifier: HT53317
2026-03-30 11:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3190d75-0c38-5aed-8a4f-5fa032f225ff with identifier: HT53317
2026-03-30 11:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3190d75-0c38-5aed-8a4f-5fa032f225ff with identifier: HT53317
2026-03-30 11:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3190d75-0c38-5aed-8a4f-5fa032f225ff with identifier: HT53317 to the API
2026-03-30 11:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b5db23a9edbaa4263250089488a3c317.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:52:20Z',
 'fuel_type': 'petrol',
 'id': 'e3190d75-0c38-5aed-8a4f-5fa032f225ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT53317',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 13679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2772447,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b5db23a9edbaa4263250089488a3c317.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_b0b28e3dfe0ce65a4e8bf9f140ac0ea1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_62fc669a5d3dc0bfca87fe78760431c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2664900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_bb6f571c65b2a8962ec25c7afc32a3ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_040685538fb451a8b08aad657ce272b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_af8810d7f45cd6a5eef121aaad1df9a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655472,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_c6bffbe377028adf7a38172b588ace7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_4d43c514bb375041e46c22e1a3b4f24d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_f6dbc3de0afb9ce095f90ebe22393341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3190d75-0c38-5aed-8a4f-5fa032f225ff/e3190d75-0c38-5aed-8a4f-5fa032f225ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/bd/63bdb3000e706c762a611c05759f8755/pa/HT53317_a810cf5172ca83019546f325a03895cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2022}
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT53317%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.be] INFO: Saving data for HT53317: {'created_time': 1774871211.144919, 'last_price_update_time': 1774871211.14493, 'auction_closing_time': 1774972340.0}
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT53317') HTTP/1.1" 204 0
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc833190>
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_dac902bc1668f6be772636f96c48e7d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_dac902bc1668f6be772636f96c48e7d8.jpg saved to cache
2026-03-30 11:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de819250>
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fd1%252F2ad1c6289f94060b5e2be20dc9ea5f1d%252Fpa%252FDT44623_8a669d979e176d2658147f8866e352bb.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_8a669d979e176d2658147f8866e352bb.jpg saved to cache
2026-03-30 11:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f32f9d16-fba1-5984-9909-1804bdb63f16
2026-03-30 11:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f32f9d16-fba1-5984-9909-1804bdb63f16, skipping ID generation
2026-03-30 11:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32f9d16-fba1-5984-9909-1804bdb63f16 with scrape type 1
2026-03-30 11:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f32f9d16-fba1-5984-9909-1804bdb63f16 sending to next pipeline
2026-03-30 11:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f32f9d16-fba1-5984-9909-1804bdb63f16, identifier: DT44623
2026-03-30 11:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f32f9d16-fba1-5984-9909-1804bdb63f16 with identifier: DT44623
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 11:46:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f32f9d16-fba1-5984-9909-1804bdb63f16 with identifier: DT44623
2026-03-30 11:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f32f9d16-fba1-5984-9909-1804bdb63f16 with identifier: DT44623 to the API
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_8a669d979e176d2658147f8866e352bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:36:02Z',
 'fuel_type': 'petrol',
 'id': 'f32f9d16-fba1-5984-9909-1804bdb63f16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT44623',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 68832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_8a669d979e176d2658147f8866e352bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_dac902bc1668f6be772636f96c48e7d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_ce93a583602b801d38bbc71c08e17e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_9dc76a3afa615c4712f8084da8e3ef5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7131df1a8c23b02fb7a2dd3d1a497f5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_7ca1f8203375982a3adce1a4e975d8bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_bd5f4ef2a6bd5a09902761a9ff8c55c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_fdf900d04391e17297eba1f59deb26b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_48179d329b8e8f1c389add8b2b5fc21d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f32f9d16-fba1-5984-9909-1804bdb63f16/f32f9d16-fba1-5984-9909-1804bdb63f16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/d1/2ad1c6289f94060b5e2be20dc9ea5f1d/pa/DT44623_11307dd1345ba85613d7fbeaa79cd720.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44623%27 HTTP/1.1" 200 None
2026-03-30 11:46:51 [auto1.be] INFO: Saving data for DT44623: {'created_time': 1774871211.887506, 'last_price_update_time': 1774871211.887516, 'auction_closing_time': 1774971362.0}
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT44623') HTTP/1.1" 204 0
2026-03-30 11:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST95230> (referer: https://www.auto1.com/v1/car-details-view/ST95230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ae4950-5821-52c2-881e-e9874a7fd588 with identifier: ST95230
2026-03-30 11:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ae4950-5821-52c2-881e-e9874a7fd588 with scrape type 1
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_8b72f1e47bb3ccc7c3e3874a9b850345.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_8b72f1e47bb3ccc7c3e3874a9b850345.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_0513866071a077734e37f87e82c59430.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_0513866071a077734e37f87e82c59430.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_00df10c7771ae964537f07cb774f91dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_00df10c7771ae964537f07cb774f91dd.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_9faa6b6673a2f6d12573a50f25ef0103.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_9faa6b6673a2f6d12573a50f25ef0103.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_7cd99d403a81817ae265ff0654f21081.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7cd99d403a81817ae265ff0654f21081.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_b26076e1d33eec19a79eef421f289a51.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_b26076e1d33eec19a79eef421f289a51.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_d086ddd4eb384ee910c76679d0da50c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d086ddd4eb384ee910c76679d0da50c4.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_407cfecdda3f10dd62a92e581f69b495.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_407cfecdda3f10dd62a92e581f69b495.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_d83b4f62c7516077283df756be65cad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d83b4f62c7516077283df756be65cad8.jpg not downloaded yet
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_7289c24a5489c844ad5817349aae2eed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7289c24a5489c844ad5817349aae2eed.jpg not downloaded yet
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR48078> (referer: https://www.auto1.com/v1/car-details-view/LR48078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7289c24a5489c844ad5817349aae2eed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaf10bc7-361f-59d8-b517-541a097be8be with identifier: LR48078
2026-03-30 11:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaf10bc7-361f-59d8-b517-541a097be8be with scrape type 1
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_98be2eb7d7733145df1a22ce4dd4ba98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_98be2eb7d7733145df1a22ce4dd4ba98.jpg not downloaded yet
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_ebb127d0b486aa82d415a4a3b52e1955.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_ebb127d0b486aa82d415a4a3b52e1955.jpg not downloaded yet
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_e2c8d8b45b839ec7db898d01be5d986d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_e2c8d8b45b839ec7db898d01be5d986d.jpg not downloaded yet
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d83b4f62c7516077283df756be65cad8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_1c406b941d45981febb511ae61543493.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_1c406b941d45981febb511ae61543493.jpg not downloaded yet
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_edb32ad224dad3ab57497ecc4bf61ffd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_edb32ad224dad3ab57497ecc4bf61ffd.jpg not downloaded yet
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_904e57f5fc7536374381654a757fdd70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_904e57f5fc7536374381654a757fdd70.jpg not downloaded yet
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_758dc609669f85246b955ab409ffff47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_758dc609669f85246b955ab409ffff47.jpg not downloaded yet
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994f90>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_7289c24a5489c844ad5817349aae2eed.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7289c24a5489c844ad5817349aae2eed.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_6fd379075f5805ed67a5313531936c20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_6fd379075f5805ed67a5313531936c20.jpg not downloaded yet
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_e2c8d8b45b839ec7db898d01be5d986d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_c94f215a3561da4f0540f6c042bc7e52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_c94f215a3561da4f0540f6c042bc7e52.jpg not downloaded yet
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_420053de2f1549c87d2da7fb82d91968.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_420053de2f1549c87d2da7fb82d91968.jpg not downloaded yet
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c6ed0>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_d83b4f62c7516077283df756be65cad8.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d83b4f62c7516077283df756be65cad8.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_758dc609669f85246b955ab409ffff47.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc920550>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_e2c8d8b45b839ec7db898d01be5d986d.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_e2c8d8b45b839ec7db898d01be5d986d.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_420053de2f1549c87d2da7fb82d91968.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc923bd0>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_758dc609669f85246b955ab409ffff47.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_758dc609669f85246b955ab409ffff47.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_c94f215a3561da4f0540f6c042bc7e52.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc846590>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_420053de2f1549c87d2da7fb82d91968.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_420053de2f1549c87d2da7fb82d91968.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_6fd379075f5805ed67a5313531936c20.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc759a10>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_c94f215a3561da4f0540f6c042bc7e52.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_c94f215a3561da4f0540f6c042bc7e52.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_904e57f5fc7536374381654a757fdd70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5d0f90>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_6fd379075f5805ed67a5313531936c20.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_6fd379075f5805ed67a5313531936c20.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_edb32ad224dad3ab57497ecc4bf61ffd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5d3f90>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_904e57f5fc7536374381654a757fdd70.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_904e57f5fc7536374381654a757fdd70.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_1c406b941d45981febb511ae61543493.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc826cd0>
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_edb32ad224dad3ab57497ecc4bf61ffd.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_edb32ad224dad3ab57497ecc4bf61ffd.jpg saved to cache
2026-03-30 11:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_ebb127d0b486aa82d415a4a3b52e1955.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc844ed0>
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_1c406b941d45981febb511ae61543493.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_1c406b941d45981febb511ae61543493.jpg saved to cache
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_98be2eb7d7733145df1a22ce4dd4ba98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78f050>
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_ebb127d0b486aa82d415a4a3b52e1955.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_ebb127d0b486aa82d415a4a3b52e1955.jpg saved to cache
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_407cfecdda3f10dd62a92e581f69b495.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc855d50>
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9f%252Fea9f8dc74d2f35dc4c1a8b8315d81b14%252Fpa%252FLR48078_98be2eb7d7733145df1a22ce4dd4ba98.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_98be2eb7d7733145df1a22ce4dd4ba98.jpg saved to cache
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aaf10bc7-361f-59d8-b517-541a097be8be
2026-03-30 11:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aaf10bc7-361f-59d8-b517-541a097be8be, skipping ID generation
2026-03-30 11:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaf10bc7-361f-59d8-b517-541a097be8be with scrape type 1
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aaf10bc7-361f-59d8-b517-541a097be8be sending to next pipeline
2026-03-30 11:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aaf10bc7-361f-59d8-b517-541a097be8be, identifier: LR48078
2026-03-30 11:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aaf10bc7-361f-59d8-b517-541a097be8be with identifier: LR48078
2026-03-30 11:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aaf10bc7-361f-59d8-b517-541a097be8be with identifier: LR48078
2026-03-30 11:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aaf10bc7-361f-59d8-b517-541a097be8be with identifier: LR48078 to the API
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_98be2eb7d7733145df1a22ce4dd4ba98.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:58:25Z',
 'fuel_type': 'petrol',
 'id': 'aaf10bc7-361f-59d8-b517-541a097be8be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR48078',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 7200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_98be2eb7d7733145df1a22ce4dd4ba98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_ebb127d0b486aa82d415a4a3b52e1955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_e2c8d8b45b839ec7db898d01be5d986d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_1c406b941d45981febb511ae61543493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_edb32ad224dad3ab57497ecc4bf61ffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_904e57f5fc7536374381654a757fdd70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_758dc609669f85246b955ab409ffff47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_6fd379075f5805ed67a5313531936c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_c94f215a3561da4f0540f6c042bc7e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaf10bc7-361f-59d8-b517-541a097be8be/aaf10bc7-361f-59d8-b517-541a097be8be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9f/ea9f8dc74d2f35dc4c1a8b8315d81b14/pa/LR48078_420053de2f1549c87d2da7fb82d91968.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2025}
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR48078%27 HTTP/1.1" 200 None
2026-03-30 11:46:54 [auto1.be] INFO: Saving data for LR48078: {'created_time': 1774871214.805415, 'last_price_update_time': 1774871214.805426, 'auction_closing_time': 1774972705.0}
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LR48078') HTTP/1.1" 204 0
2026-03-30 11:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d086ddd4eb384ee910c76679d0da50c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c03d0>
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_407cfecdda3f10dd62a92e581f69b495.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_407cfecdda3f10dd62a92e581f69b495.jpg saved to cache
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73ec4d6b50>
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_d086ddd4eb384ee910c76679d0da50c4.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d086ddd4eb384ee910c76679d0da50c4.jpg saved to cache
2026-03-30 11:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_b26076e1d33eec19a79eef421f289a51.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7cd99d403a81817ae265ff0654f21081.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc929650>
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_b26076e1d33eec19a79eef421f289a51.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_b26076e1d33eec19a79eef421f289a51.jpg saved to cache
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c2050>
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_7cd99d403a81817ae265ff0654f21081.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7cd99d403a81817ae265ff0654f21081.jpg saved to cache
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_9faa6b6673a2f6d12573a50f25ef0103.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_00df10c7771ae964537f07cb774f91dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ac290>
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_9faa6b6673a2f6d12573a50f25ef0103.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_9faa6b6673a2f6d12573a50f25ef0103.jpg saved to cache
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_0513866071a077734e37f87e82c59430.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8273d0>
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_00df10c7771ae964537f07cb774f91dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_00df10c7771ae964537f07cb774f91dd.jpg saved to cache
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_8b72f1e47bb3ccc7c3e3874a9b850345.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c2b10>
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_0513866071a077734e37f87e82c59430.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_0513866071a077734e37f87e82c59430.jpg saved to cache
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK43938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b0790>
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F94%252Fff946214e03432396f6edc50e092f51f%252Fpa%252FST95230_8b72f1e47bb3ccc7c3e3874a9b850345.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_8b72f1e47bb3ccc7c3e3874a9b850345.jpg saved to cache
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9ae4950-5821-52c2-881e-e9874a7fd588
2026-03-30 11:46:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9ae4950-5821-52c2-881e-e9874a7fd588, skipping ID generation
2026-03-30 11:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ae4950-5821-52c2-881e-e9874a7fd588 with scrape type 1
2026-03-30 11:46:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9ae4950-5821-52c2-881e-e9874a7fd588 sending to next pipeline
2026-03-30 11:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9ae4950-5821-52c2-881e-e9874a7fd588, identifier: ST95230
2026-03-30 11:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9ae4950-5821-52c2-881e-e9874a7fd588 with identifier: ST95230
2026-03-30 11:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9ae4950-5821-52c2-881e-e9874a7fd588 with identifier: ST95230
2026-03-30 11:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9ae4950-5821-52c2-881e-e9874a7fd588 with identifier: ST95230 to the API
2026-03-30 11:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_8b72f1e47bb3ccc7c3e3874a9b850345.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:34:16Z',
 'fuel_type': 'petrol',
 'id': 'a9ae4950-5821-52c2-881e-e9874a7fd588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST95230',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 128612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_8b72f1e47bb3ccc7c3e3874a9b850345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_0513866071a077734e37f87e82c59430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_00df10c7771ae964537f07cb774f91dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_9faa6b6673a2f6d12573a50f25ef0103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7cd99d403a81817ae265ff0654f21081.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_b26076e1d33eec19a79eef421f289a51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d086ddd4eb384ee910c76679d0da50c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_407cfecdda3f10dd62a92e581f69b495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_d83b4f62c7516077283df756be65cad8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ae4950-5821-52c2-881e-e9874a7fd588/a9ae4950-5821-52c2-881e-e9874a7fd588_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/94/ff946214e03432396f6edc50e092f51f/pa/ST95230_7289c24a5489c844ad5817349aae2eed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2003}
2026-03-30 11:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST95230%27 HTTP/1.1" 200 None
2026-03-30 11:46:56 [auto1.be] INFO: Saving data for ST95230: {'created_time': 1774871216.253438, 'last_price_update_time': 1774871216.253447, 'auction_closing_time': 1774971256.0}
2026-03-30 11:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST95230') HTTP/1.1" 204 0
2026-03-30 11:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV37866> (referer: https://www.auto1.com/v1/car-details-view/LV37866/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea with identifier: LV37866
2026-03-30 11:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea with scrape type 1
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_d7ae613d06dc6b6594915a5e53845855.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_d7ae613d06dc6b6594915a5e53845855.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_599e2215392328657ef08530b9cf6565.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_599e2215392328657ef08530b9cf6565.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_c8dd877d98c36dd2d4ebf97205f41dc9.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_c8dd877d98c36dd2d4ebf97205f41dc9.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_5961a82fe473c51f367fcb5dff5720e7.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_5961a82fe473c51f367fcb5dff5720e7.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_f0e7590a877f3ff14392fea63e231f78.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f0e7590a877f3ff14392fea63e231f78.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_55c9ff4fc9ba36677191998917685944.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_55c9ff4fc9ba36677191998917685944.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_f5a960b3ede4a2069434ac5bb496b530.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f5a960b3ede4a2069434ac5bb496b530.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_6311ab13c0fe82b31d247cd44ed9c236.png%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_6311ab13c0fe82b31d247cd44ed9c236.png not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_b86f5cc867b1d96795c531613ce786ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_b86f5cc867b1d96795c531613ce786ff.jpg not downloaded yet
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_cf8fdcd4a61d72055ad0e4df112324ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_cf8fdcd4a61d72055ad0e4df112324ad.jpg not downloaded yet
2026-03-30 11:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG06141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ45514/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_cf8fdcd4a61d72055ad0e4df112324ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc758d90>
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_cf8fdcd4a61d72055ad0e4df112324ad.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_cf8fdcd4a61d72055ad0e4df112324ad.jpg saved to cache
2026-03-30 11:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_b86f5cc867b1d96795c531613ce786ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc72e990>
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_b86f5cc867b1d96795c531613ce786ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_b86f5cc867b1d96795c531613ce786ff.jpg saved to cache
2026-03-30 11:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC48774> (referer: https://www.auto1.com/v1/car-details-view/SC48774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36b86f5-09e8-5057-8c55-fa231f6c05cd with identifier: SC48774
2026-03-30 11:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36b86f5-09e8-5057-8c55-fa231f6c05cd with scrape type 1
2026-03-30 11:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f36b86f5-09e8-5057-8c55-fa231f6c05cd
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_1ed8abed4ced1318e0433310d587c2f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_1ed8abed4ced1318e0433310d587c2f9.jpg already downloaded
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_7e03859c63e80cfbb0af76cdf856fb7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_7e03859c63e80cfbb0af76cdf856fb7f.jpg already downloaded
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_0c4108e04f6988359495bdb7f80fc665.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_0c4108e04f6988359495bdb7f80fc665.jpg already downloaded
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_9c171e74cc52b52321b73fc5ccc8bf2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_9c171e74cc52b52321b73fc5ccc8bf2d.jpg already downloaded
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_059a1491b137e3ec68ba88b9d08fd3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_059a1491b137e3ec68ba88b9d08fd3ac.jpg already downloaded
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_f8a6101bf4d2d663a52e2b73a9535ab0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_f8a6101bf4d2d663a52e2b73a9535ab0.jpg already downloaded
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_634844139a8f4c33a9103a883617b1f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_634844139a8f4c33a9103a883617b1f9.jpg already downloaded
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_4220648690e60dfe5134b635338a8d2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_4220648690e60dfe5134b635338a8d2b.jpg already downloaded
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_df4cf89b616d8e9ccc8d49bdeaec3763.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_df4cf89b616d8e9ccc8d49bdeaec3763.jpg already downloaded
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fd9%252Fbad936bfe92b29c5b615dc57ca2e6fe4%252Fpa%252FSC48774_0359b395ff823174978d9b1bd0e4446a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_0359b395ff823174978d9b1bd0e4446a.jpg already downloaded
2026-03-30 11:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f36b86f5-09e8-5057-8c55-fa231f6c05cd, identifier: SC48774
2026-03-30 11:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f36b86f5-09e8-5057-8c55-fa231f6c05cd with identifier: SC48774
2026-03-30 11:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f36b86f5-09e8-5057-8c55-fa231f6c05cd with identifier: SC48774
2026-03-30 11:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f36b86f5-09e8-5057-8c55-fa231f6c05cd with identifier: SC48774 to the API
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC48774>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:20:02Z',
 'fuel_type': 'petrol',
 'id': 'f36b86f5-09e8-5057-8c55-fa231f6c05cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC48774',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 135099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_1ed8abed4ced1318e0433310d587c2f9.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_7e03859c63e80cfbb0af76cdf856fb7f.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_0c4108e04f6988359495bdb7f80fc665.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_9c171e74cc52b52321b73fc5ccc8bf2d.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_059a1491b137e3ec68ba88b9d08fd3ac.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_f8a6101bf4d2d663a52e2b73a9535ab0.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_634844139a8f4c33a9103a883617b1f9.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_4220648690e60dfe5134b635338a8d2b.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_df4cf89b616d8e9ccc8d49bdeaec3763.jpg',
                'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_0359b395ff823174978d9b1bd0e4446a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_1ed8abed4ced1318e0433310d587c2f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_7e03859c63e80cfbb0af76cdf856fb7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354118,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_0c4108e04f6988359495bdb7f80fc665.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_9c171e74cc52b52321b73fc5ccc8bf2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2374543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_059a1491b137e3ec68ba88b9d08fd3ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_f8a6101bf4d2d663a52e2b73a9535ab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_634844139a8f4c33a9103a883617b1f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_4220648690e60dfe5134b635338a8d2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_df4cf89b616d8e9ccc8d49bdeaec3763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36b86f5-09e8-5057-8c55-fa231f6c05cd/f36b86f5-09e8-5057-8c55-fa231f6c05cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/d9/bad936bfe92b29c5b615dc57ca2e6fe4/pa/SC48774_0359b395ff823174978d9b1bd0e4446a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2013}
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC48774%27 HTTP/1.1" 200 None
2026-03-30 11:47:05 [auto1.be] INFO: Saving data for SC48774: {'created_time': 1774871225.55657, 'last_price_update_time': 1774871225.55658, 'auction_closing_time': 1774970402.0}
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC48774') HTTP/1.1" 204 0
2026-03-30 11:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_6311ab13c0fe82b31d247cd44ed9c236.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:05 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86e790>
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_7.png HTTP/1.1" 201 0
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_6311ab13c0fe82b31d247cd44ed9c236.png') HTTP/1.1" 204 0
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_6311ab13c0fe82b31d247cd44ed9c236.png saved to cache
2026-03-30 11:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f5a960b3ede4a2069434ac5bb496b530.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:05 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:05 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc819ed0>
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_6.png HTTP/1.1" 201 0
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_f5a960b3ede4a2069434ac5bb496b530.png') HTTP/1.1" 204 0
2026-03-30 11:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f5a960b3ede4a2069434ac5bb496b530.png saved to cache
2026-03-30 11:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_55c9ff4fc9ba36677191998917685944.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b0990>
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_5.png HTTP/1.1" 201 0
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_55c9ff4fc9ba36677191998917685944.png') HTTP/1.1" 204 0
2026-03-30 11:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_55c9ff4fc9ba36677191998917685944.png saved to cache
2026-03-30 11:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD22727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f0e7590a877f3ff14392fea63e231f78.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86db10>
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_4.png HTTP/1.1" 201 0
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_f0e7590a877f3ff14392fea63e231f78.png') HTTP/1.1" 204 0
2026-03-30 11:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f0e7590a877f3ff14392fea63e231f78.png saved to cache
2026-03-30 11:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_5961a82fe473c51f367fcb5dff5720e7.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_c8dd877d98c36dd2d4ebf97205f41dc9.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ad7d0>
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_3.png HTTP/1.1" 201 0
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_5961a82fe473c51f367fcb5dff5720e7.png') HTTP/1.1" 204 0
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_5961a82fe473c51f367fcb5dff5720e7.png saved to cache
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:07 [scrapy.extensions.logstats] INFO: Crawled 133 pages (at 30 pages/min), scraped 92 items (at 20 items/min)
2026-03-30 11:47:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 168MiB
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f6a10>
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_2.png HTTP/1.1" 201 0
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_c8dd877d98c36dd2d4ebf97205f41dc9.png') HTTP/1.1" 204 0
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_c8dd877d98c36dd2d4ebf97205f41dc9.png saved to cache
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_599e2215392328657ef08530b9cf6565.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc923190>
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_1.png HTTP/1.1" 201 0
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_599e2215392328657ef08530b9cf6565.png') HTTP/1.1" 204 0
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_599e2215392328657ef08530b9cf6565.png saved to cache
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_d7ae613d06dc6b6594915a5e53845855.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7a9e10>
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_0.png HTTP/1.1" 201 0
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fd7%252Ff2d7183ad67b7fc4bda56d467172a34a%252Fpa%252FLV37866_d7ae613d06dc6b6594915a5e53845855.png') HTTP/1.1" 204 0
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_d7ae613d06dc6b6594915a5e53845855.png saved to cache
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea
2026-03-30 11:47:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea, skipping ID generation
2026-03-30 11:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea with scrape type 1
2026-03-30 11:47:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea sending to next pipeline
2026-03-30 11:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea, identifier: LV37866
2026-03-30 11:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea with identifier: LV37866
2026-03-30 11:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea with identifier: LV37866
2026-03-30 11:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea with identifier: LV37866 to the API
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_d7ae613d06dc6b6594915a5e53845855.png>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:22:42Z',
 'fuel_type': 'diesel',
 'id': 'dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV37866',
 'listing': 'auction',
 'location': 'BE, Tongeren',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 43622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 1041222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_d7ae613d06dc6b6594915a5e53845855.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 1041222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_599e2215392328657ef08530b9cf6565.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 901219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_c8dd877d98c36dd2d4ebf97205f41dc9.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 901219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_5961a82fe473c51f367fcb5dff5720e7.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 951127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f0e7590a877f3ff14392fea63e231f78.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 1097138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_55c9ff4fc9ba36677191998917685944.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 1097138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_f5a960b3ede4a2069434ac5bb496b530.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 1097138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_6311ab13c0fe82b31d247cd44ed9c236.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_b86f5cc867b1d96795c531613ce786ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea/dbcea6da-5489-5fb9-b530-bd2c5cf0b6ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/d7/f2d7183ad67b7fc4bda56d467172a34a/pa/LV37866_cf8fdcd4a61d72055ad0e4df112324ad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
 'transmission': 'manual',
 'trim': '300 L2 Trend',
 'year': 2023}
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LV37866%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [auto1.be] INFO: Saving data for LV37866: {'created_time': 1774871228.057048, 'last_price_update_time': 1774871228.05706, 'auction_closing_time': 1774970562.0}
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LV37866') HTTP/1.1" 204 0
2026-03-30 11:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV32890> (referer: https://www.auto1.com/v1/car-details-view/FV32890/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469e7d78-7ca8-5fc8-a0b5-c480d03cae24 with identifier: FV32890
2026-03-30 11:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469e7d78-7ca8-5fc8-a0b5-c480d03cae24 with scrape type 1
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 469e7d78-7ca8-5fc8-a0b5-c480d03cae24
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_548e5434ed321ff7eba5598e6974f92a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_548e5434ed321ff7eba5598e6974f92a.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_bdec3a5b4fee3f4508957913e5865ee6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_bdec3a5b4fee3f4508957913e5865ee6.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_3e27fb4f1a461accbbfcca88eed63cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_3e27fb4f1a461accbbfcca88eed63cb6.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_8488d790ea2c1f18253fd694cdac361e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_8488d790ea2c1f18253fd694cdac361e.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_f7a809cc478734d794bf4f140ebe75ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_f7a809cc478734d794bf4f140ebe75ce.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_0043209fcb33f59008950f80f36bc164.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_0043209fcb33f59008950f80f36bc164.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_7f6c36d5fdfc9ad72b3d53ad0b08aa71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_7f6c36d5fdfc9ad72b3d53ad0b08aa71.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_443915a6c73b7fea3fdb6f74ea41f092.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_443915a6c73b7fea3fdb6f74ea41f092.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_dc5ec1dec38b7101bcfd6e62ade1646c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_dc5ec1dec38b7101bcfd6e62ade1646c.jpg already downloaded
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252Fd5%252F1fd5c1e40f9103e32e0d50c4eab69d1e%252Fpa%252FFV32890_58c4dd5e68b4383cd33677b935438a38.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_58c4dd5e68b4383cd33677b935438a38.jpg already downloaded
2026-03-30 11:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 469e7d78-7ca8-5fc8-a0b5-c480d03cae24, identifier: FV32890
2026-03-30 11:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 469e7d78-7ca8-5fc8-a0b5-c480d03cae24 with identifier: FV32890
2026-03-30 11:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 469e7d78-7ca8-5fc8-a0b5-c480d03cae24 with identifier: FV32890
2026-03-30 11:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 469e7d78-7ca8-5fc8-a0b5-c480d03cae24 with identifier: FV32890 to the API
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FV32890>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:41:32Z',
 'fuel_type': 'petrol',
 'id': '469e7d78-7ca8-5fc8-a0b5-c480d03cae24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV32890',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 8549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_548e5434ed321ff7eba5598e6974f92a.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_bdec3a5b4fee3f4508957913e5865ee6.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_3e27fb4f1a461accbbfcca88eed63cb6.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_8488d790ea2c1f18253fd694cdac361e.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_f7a809cc478734d794bf4f140ebe75ce.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_0043209fcb33f59008950f80f36bc164.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_7f6c36d5fdfc9ad72b3d53ad0b08aa71.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_443915a6c73b7fea3fdb6f74ea41f092.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_dc5ec1dec38b7101bcfd6e62ade1646c.jpg',
                'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_58c4dd5e68b4383cd33677b935438a38.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_548e5434ed321ff7eba5598e6974f92a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_bdec3a5b4fee3f4508957913e5865ee6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_3e27fb4f1a461accbbfcca88eed63cb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_8488d790ea2c1f18253fd694cdac361e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_f7a809cc478734d794bf4f140ebe75ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_0043209fcb33f59008950f80f36bc164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401938,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_7f6c36d5fdfc9ad72b3d53ad0b08aa71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_443915a6c73b7fea3fdb6f74ea41f092.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_dc5ec1dec38b7101bcfd6e62ade1646c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_469e7d78-7ca8-5fc8-a0b5-c480d03cae24/469e7d78-7ca8-5fc8-a0b5-c480d03cae24_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/d5/1fd5c1e40f9103e32e0d50c4eab69d1e/pa/FV32890_58c4dd5e68b4383cd33677b935438a38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2022}
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV32890%27 HTTP/1.1" 200 None
2026-03-30 11:47:08 [auto1.be] INFO: Saving data for FV32890: {'created_time': 1774871228.7794, 'last_price_update_time': 1774871228.779418, 'auction_closing_time': 1774971692.0}
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV32890') HTTP/1.1" 204 0
2026-03-30 11:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK60996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS39251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK88791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW43173/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG06141> (referer: https://www.auto1.com/v1/car-details-view/SG06141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51728403-42b7-56d6-b559-d250dc716f96 with identifier: SG06141
2026-03-30 11:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51728403-42b7-56d6-b559-d250dc716f96 with scrape type 1
2026-03-30 11:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_5dd8556de5b781e0fbdff78bdd255d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5dd8556de5b781e0fbdff78bdd255d39.jpg not downloaded yet
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_5ce72fa8659b36a767cc6368430e82c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5ce72fa8659b36a767cc6368430e82c1.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_613f1ab5ba42c04a88787f715f395a2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_613f1ab5ba42c04a88787f715f395a2d.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_a1961d39f983bb6df25f122bcfe35fce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_a1961d39f983bb6df25f122bcfe35fce.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_11cc8044486f9741ffd15b6f0fe23216.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_11cc8044486f9741ffd15b6f0fe23216.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_31faf77850a1df3ceca66d40d821e5e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_31faf77850a1df3ceca66d40d821e5e8.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_368d5d1547282cc1ed3d400f8d7c4837.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_368d5d1547282cc1ed3d400f8d7c4837.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_d5ded744d6a7792b145f2994b2ccf875.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_d5ded744d6a7792b145f2994b2ccf875.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_b6846e90ef7efbc534e028ec4a3251fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_b6846e90ef7efbc534e028ec4a3251fe.jpg not downloaded yet
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_8cff16042b188441f659260c210f07bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_8cff16042b188441f659260c210f07bc.jpg not downloaded yet
2026-03-30 11:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA70218> (referer: https://www.auto1.com/v1/car-details-view/PA70218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eece8f6-578f-50d4-8b08-69c3a12ac924 with identifier: PA70218
2026-03-30 11:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eece8f6-578f-50d4-8b08-69c3a12ac924 with scrape type 1
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_92ba06c719a4b91b20b029402a25a7b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_92ba06c719a4b91b20b029402a25a7b5.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_08b8662dbbab1f217c028f9f3469c34d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_08b8662dbbab1f217c028f9f3469c34d.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_7b355f2b25141f3853ac7946f93228c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_7b355f2b25141f3853ac7946f93228c6.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_0e79559b96e6b4b6e053b74acc1200d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_0e79559b96e6b4b6e053b74acc1200d1.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_464c0d3a7d7dfa35247edba83a5f5f73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_464c0d3a7d7dfa35247edba83a5f5f73.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_6e8616755f0cb1e21bf752aa66c61865.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_6e8616755f0cb1e21bf752aa66c61865.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_8bff3e2b6f7949a34ab3305d749561d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_8bff3e2b6f7949a34ab3305d749561d1.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_9875b5206ba7aa0b879665d31414ff97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_9875b5206ba7aa0b879665d31414ff97.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_404f36151da0d30db7e7a9437a5ba7ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_404f36151da0d30db7e7a9437a5ba7ee.jpg not downloaded yet
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_74afdc54f3786f93476eff91ffba9e2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_74afdc54f3786f93476eff91ffba9e2f.jpg not downloaded yet
2026-03-30 11:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_8cff16042b188441f659260c210f07bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_74afdc54f3786f93476eff91ffba9e2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc882f10>
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_8cff16042b188441f659260c210f07bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_8cff16042b188441f659260c210f07bc.jpg saved to cache
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_404f36151da0d30db7e7a9437a5ba7ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86db10>
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_74afdc54f3786f93476eff91ffba9e2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_74afdc54f3786f93476eff91ffba9e2f.jpg saved to cache
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ab790>
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_404f36151da0d30db7e7a9437a5ba7ee.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_404f36151da0d30db7e7a9437a5ba7ee.jpg saved to cache
2026-03-30 11:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_9875b5206ba7aa0b879665d31414ff97.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc881c90>
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_9875b5206ba7aa0b879665d31414ff97.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_9875b5206ba7aa0b879665d31414ff97.jpg saved to cache
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_8bff3e2b6f7949a34ab3305d749561d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f48d0>
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_8bff3e2b6f7949a34ab3305d749561d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_8bff3e2b6f7949a34ab3305d749561d1.jpg saved to cache
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_6e8616755f0cb1e21bf752aa66c61865.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7abdd0>
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_6e8616755f0cb1e21bf752aa66c61865.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_6e8616755f0cb1e21bf752aa66c61865.jpg saved to cache
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_464c0d3a7d7dfa35247edba83a5f5f73.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_0e79559b96e6b4b6e053b74acc1200d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc759250>
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_464c0d3a7d7dfa35247edba83a5f5f73.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_464c0d3a7d7dfa35247edba83a5f5f73.jpg saved to cache
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_7b355f2b25141f3853ac7946f93228c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca6c990>
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_0e79559b96e6b4b6e053b74acc1200d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_0e79559b96e6b4b6e053b74acc1200d1.jpg saved to cache
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0a190>
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_7b355f2b25141f3853ac7946f93228c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_7b355f2b25141f3853ac7946f93228c6.jpg saved to cache
2026-03-30 11:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_08b8662dbbab1f217c028f9f3469c34d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_92ba06c719a4b91b20b029402a25a7b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86fa90>
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_08b8662dbbab1f217c028f9f3469c34d.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_08b8662dbbab1f217c028f9f3469c34d.jpg saved to cache
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc72c2d0>
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fd2%252Fd1d25525d802dcc68b8c040a8c7cbe56%252Fpa%252FPA70218_92ba06c719a4b91b20b029402a25a7b5.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_92ba06c719a4b91b20b029402a25a7b5.jpg saved to cache
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3eece8f6-578f-50d4-8b08-69c3a12ac924
2026-03-30 11:47:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3eece8f6-578f-50d4-8b08-69c3a12ac924, skipping ID generation
2026-03-30 11:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eece8f6-578f-50d4-8b08-69c3a12ac924 with scrape type 1
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3eece8f6-578f-50d4-8b08-69c3a12ac924 sending to next pipeline
2026-03-30 11:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3eece8f6-578f-50d4-8b08-69c3a12ac924, identifier: PA70218
2026-03-30 11:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3eece8f6-578f-50d4-8b08-69c3a12ac924 with identifier: PA70218
2026-03-30 11:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3eece8f6-578f-50d4-8b08-69c3a12ac924 with identifier: PA70218
2026-03-30 11:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3eece8f6-578f-50d4-8b08-69c3a12ac924 with identifier: PA70218 to the API
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_92ba06c719a4b91b20b029402a25a7b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:39:34Z',
 'fuel_type': 'diesel',
 'id': '3eece8f6-578f-50d4-8b08-69c3a12ac924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA70218',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 180073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_92ba06c719a4b91b20b029402a25a7b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_08b8662dbbab1f217c028f9f3469c34d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_7b355f2b25141f3853ac7946f93228c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_0e79559b96e6b4b6e053b74acc1200d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_464c0d3a7d7dfa35247edba83a5f5f73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_6e8616755f0cb1e21bf752aa66c61865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_8bff3e2b6f7949a34ab3305d749561d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_9875b5206ba7aa0b879665d31414ff97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_404f36151da0d30db7e7a9437a5ba7ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eece8f6-578f-50d4-8b08-69c3a12ac924/3eece8f6-578f-50d4-8b08-69c3a12ac924_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/d2/d1d25525d802dcc68b8c040a8c7cbe56/pa/PA70218_74afdc54f3786f93476eff91ffba9e2f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2018}
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA70218%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [auto1.be] INFO: Saving data for PA70218: {'created_time': 1774871238.671344, 'last_price_update_time': 1774871238.671356, 'auction_closing_time': 1774971574.0}
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PA70218') HTTP/1.1" 204 0
2026-03-30 11:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_b6846e90ef7efbc534e028ec4a3251fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ45514> (referer: https://www.auto1.com/v1/car-details-view/WZ45514/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca4e2d0>
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_b6846e90ef7efbc534e028ec4a3251fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_b6846e90ef7efbc534e028ec4a3251fe.jpg saved to cache
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ea843df-3b5a-5438-8801-a88de75ec62b with identifier: WZ45514
2026-03-30 11:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea843df-3b5a-5438-8801-a88de75ec62b with scrape type 1
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_331d0e6d7eef7ad9deb23d6c81fb0796.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_331d0e6d7eef7ad9deb23d6c81fb0796.jpg not downloaded yet
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_a80db0b90d31258af4ce6691044bf46b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_a80db0b90d31258af4ce6691044bf46b.jpg not downloaded yet
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_f94d3585658ef4ed9f14fcac442a6a3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_f94d3585658ef4ed9f14fcac442a6a3b.jpg not downloaded yet
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_ecd5d7bd5a278c006ff1eaff3daabaa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_ecd5d7bd5a278c006ff1eaff3daabaa8.jpg not downloaded yet
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_b9b8cef42901ec293ef1181e94b2d028.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_b9b8cef42901ec293ef1181e94b2d028.jpg not downloaded yet
2026-03-30 11:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_d5ded744d6a7792b145f2994b2ccf875.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_368d5d1547282cc1ed3d400f8d7c4837.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_e8c3b2a2b6e66f8d22d44b51fd7df1ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_e8c3b2a2b6e66f8d22d44b51fd7df1ea.jpg not downloaded yet
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_9db2df768e746160ada2a9a0c6caaa58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_9db2df768e746160ada2a9a0c6caaa58.jpg not downloaded yet
2026-03-30 11:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_749b9699b375027ce26d95cb20b59985.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_749b9699b375027ce26d95cb20b59985.jpg not downloaded yet
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_03fca3bc1280a5ce1ceebbdcb52c3031.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_03fca3bc1280a5ce1ceebbdcb52c3031.jpg not downloaded yet
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_53711b2b82729ebadb2c15a0be972d4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_53711b2b82729ebadb2c15a0be972d4a.jpg not downloaded yet
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8463d0>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_d5ded744d6a7792b145f2994b2ccf875.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_d5ded744d6a7792b145f2994b2ccf875.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc994a10>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_368d5d1547282cc1ed3d400f8d7c4837.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_368d5d1547282cc1ed3d400f8d7c4837.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_ecd5d7bd5a278c006ff1eaff3daabaa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_53711b2b82729ebadb2c15a0be972d4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_b9b8cef42901ec293ef1181e94b2d028.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b1e10>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_ecd5d7bd5a278c006ff1eaff3daabaa8.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_ecd5d7bd5a278c006ff1eaff3daabaa8.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86e290>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_53711b2b82729ebadb2c15a0be972d4a.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_53711b2b82729ebadb2c15a0be972d4a.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc71f110>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_b9b8cef42901ec293ef1181e94b2d028.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_b9b8cef42901ec293ef1181e94b2d028.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_03fca3bc1280a5ce1ceebbdcb52c3031.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_749b9699b375027ce26d95cb20b59985.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc774e10>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_03fca3bc1280a5ce1ceebbdcb52c3031.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_03fca3bc1280a5ce1ceebbdcb52c3031.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc845790>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_749b9699b375027ce26d95cb20b59985.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_749b9699b375027ce26d95cb20b59985.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_9db2df768e746160ada2a9a0c6caaa58.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_e8c3b2a2b6e66f8d22d44b51fd7df1ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b32d0>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_9db2df768e746160ada2a9a0c6caaa58.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_9db2df768e746160ada2a9a0c6caaa58.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK43938> (referer: https://www.auto1.com/v1/car-details-view/MK43938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c1e90>
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_e8c3b2a2b6e66f8d22d44b51fd7df1ea.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_e8c3b2a2b6e66f8d22d44b51fd7df1ea.jpg saved to cache
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_a80db0b90d31258af4ce6691044bf46b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_f94d3585658ef4ed9f14fcac442a6a3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_331d0e6d7eef7ad9deb23d6c81fb0796.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f003fbc8-bc35-51c6-a0a6-5ec88d76a016 with identifier: MK43938
2026-03-30 11:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f003fbc8-bc35-51c6-a0a6-5ec88d76a016 with scrape type 1
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f003fbc8-bc35-51c6-a0a6-5ec88d76a016
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_e4a0b2ec37042882a9af74cb2a99dd4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_e4a0b2ec37042882a9af74cb2a99dd4d.jpg already downloaded
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_2dc3772df86878f3be393a330cc33b77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_2dc3772df86878f3be393a330cc33b77.jpg already downloaded
2026-03-30 11:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_9e5b205d7b1b78c948e32675b4382f88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_9e5b205d7b1b78c948e32675b4382f88.jpg already downloaded
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_845b0a4ae990b2d4c672a2882650483c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_845b0a4ae990b2d4c672a2882650483c.jpg already downloaded
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_97093f5ba66033aa1d23c6dc4b6bc42d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_97093f5ba66033aa1d23c6dc4b6bc42d.jpg already downloaded
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_a6d8498d26e2a8ceadc83cd9b586881e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_a6d8498d26e2a8ceadc83cd9b586881e.jpg already downloaded
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_0353c946f4f039e2c856fd8978c72abe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_0353c946f4f039e2c856fd8978c72abe.jpg already downloaded
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_04f58450c24fa343ffe78726db59996c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_04f58450c24fa343ffe78726db59996c.jpg already downloaded
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_c070b0ebe3241cf6c922edcdf0e5f1cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_c070b0ebe3241cf6c922edcdf0e5f1cc.jpg already downloaded
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Ff3%252Fc5f3fa278706f2171ec39cd0a5932f99%252Fpa%252FMK43938_d2e0b36a3320b0efeec840caaf0cbc43.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_d2e0b36a3320b0efeec840caaf0cbc43.jpg already downloaded
2026-03-30 11:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f003fbc8-bc35-51c6-a0a6-5ec88d76a016, identifier: MK43938
2026-03-30 11:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f003fbc8-bc35-51c6-a0a6-5ec88d76a016 with identifier: MK43938
2026-03-30 11:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f003fbc8-bc35-51c6-a0a6-5ec88d76a016 with identifier: MK43938
2026-03-30 11:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f003fbc8-bc35-51c6-a0a6-5ec88d76a016 with identifier: MK43938 to the API
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MK43938>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:23:46Z',
 'fuel_type': 'petrol',
 'id': 'f003fbc8-bc35-51c6-a0a6-5ec88d76a016',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK43938',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '1er',
 'odometer': 180462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_e4a0b2ec37042882a9af74cb2a99dd4d.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_2dc3772df86878f3be393a330cc33b77.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_9e5b205d7b1b78c948e32675b4382f88.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_845b0a4ae990b2d4c672a2882650483c.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_97093f5ba66033aa1d23c6dc4b6bc42d.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_a6d8498d26e2a8ceadc83cd9b586881e.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_0353c946f4f039e2c856fd8978c72abe.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_04f58450c24fa343ffe78726db59996c.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_c070b0ebe3241cf6c922edcdf0e5f1cc.jpg',
                'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_d2e0b36a3320b0efeec840caaf0cbc43.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_e4a0b2ec37042882a9af74cb2a99dd4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_2dc3772df86878f3be393a330cc33b77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_9e5b205d7b1b78c948e32675b4382f88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542613,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_845b0a4ae990b2d4c672a2882650483c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_97093f5ba66033aa1d23c6dc4b6bc42d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_a6d8498d26e2a8ceadc83cd9b586881e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_0353c946f4f039e2c856fd8978c72abe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_04f58450c24fa343ffe78726db59996c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_c070b0ebe3241cf6c922edcdf0e5f1cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f003fbc8-bc35-51c6-a0a6-5ec88d76a016/f003fbc8-bc35-51c6-a0a6-5ec88d76a016_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/f3/c5f3fa278706f2171ec39cd0a5932f99/pa/MK43938_d2e0b36a3320b0efeec840caaf0cbc43.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK43938%27 HTTP/1.1" 200 None
2026-03-30 11:47:20 [auto1.be] INFO: Saving data for MK43938: {'created_time': 1774871240.570737, 'last_price_update_time': 1774871240.570749, 'auction_closing_time': 1774970626.0}
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK43938') HTTP/1.1" 204 0
2026-03-30 11:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_31faf77850a1df3ceca66d40d821e5e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_11cc8044486f9741ffd15b6f0fe23216.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9204d0>
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_a80db0b90d31258af4ce6691044bf46b.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_a80db0b90d31258af4ce6691044bf46b.jpg saved to cache
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c6e10>
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_f94d3585658ef4ed9f14fcac442a6a3b.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_f94d3585658ef4ed9f14fcac442a6a3b.jpg saved to cache
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc86f4d0>
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fde%252F4cdece44e59b9333b1d1b5fa7354ecac%252Fpa%252FWZ45514_331d0e6d7eef7ad9deb23d6c81fb0796.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_331d0e6d7eef7ad9deb23d6c81fb0796.jpg saved to cache
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ea843df-3b5a-5438-8801-a88de75ec62b
2026-03-30 11:47:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ea843df-3b5a-5438-8801-a88de75ec62b, skipping ID generation
2026-03-30 11:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea843df-3b5a-5438-8801-a88de75ec62b with scrape type 1
2026-03-30 11:47:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ea843df-3b5a-5438-8801-a88de75ec62b sending to next pipeline
2026-03-30 11:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ea843df-3b5a-5438-8801-a88de75ec62b, identifier: WZ45514
2026-03-30 11:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ea843df-3b5a-5438-8801-a88de75ec62b with identifier: WZ45514
2026-03-30 11:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ea843df-3b5a-5438-8801-a88de75ec62b with identifier: WZ45514
2026-03-30 11:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ea843df-3b5a-5438-8801-a88de75ec62b with identifier: WZ45514 to the API
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_331d0e6d7eef7ad9deb23d6c81fb0796.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:46:00Z',
 'fuel_type': 'diesel',
 'id': '3ea843df-3b5a-5438-8801-a88de75ec62b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ45514',
 'listing': 'auction',
 'location': 'BE, Aarschot',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 139842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_331d0e6d7eef7ad9deb23d6c81fb0796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_a80db0b90d31258af4ce6691044bf46b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_f94d3585658ef4ed9f14fcac442a6a3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_ecd5d7bd5a278c006ff1eaff3daabaa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_b9b8cef42901ec293ef1181e94b2d028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_e8c3b2a2b6e66f8d22d44b51fd7df1ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_9db2df768e746160ada2a9a0c6caaa58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_749b9699b375027ce26d95cb20b59985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_03fca3bc1280a5ce1ceebbdcb52c3031.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea843df-3b5a-5438-8801-a88de75ec62b/3ea843df-3b5a-5438-8801-a88de75ec62b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/de/4cdece44e59b9333b1d1b5fa7354ecac/pa/WZ45514_53711b2b82729ebadb2c15a0be972d4a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 20d Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2018}
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ45514%27 HTTP/1.1" 200 None
2026-03-30 11:47:21 [auto1.be] INFO: Saving data for WZ45514: {'created_time': 1774871241.321183, 'last_price_update_time': 1774871241.321195, 'auction_closing_time': 1774971960.0}
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ45514') HTTP/1.1" 204 0
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca45d50>
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_31faf77850a1df3ceca66d40d821e5e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_31faf77850a1df3ceca66d40d821e5e8.jpg saved to cache
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca571d0>
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_11cc8044486f9741ffd15b6f0fe23216.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_11cc8044486f9741ffd15b6f0fe23216.jpg saved to cache
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_a1961d39f983bb6df25f122bcfe35fce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5ce72fa8659b36a767cc6368430e82c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc73e090>
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_a1961d39f983bb6df25f122bcfe35fce.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_a1961d39f983bb6df25f122bcfe35fce.jpg saved to cache
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_613f1ab5ba42c04a88787f715f395a2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7a2010>
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_5ce72fa8659b36a767cc6368430e82c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5ce72fa8659b36a767cc6368430e82c1.jpg saved to cache
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5dd8556de5b781e0fbdff78bdd255d39.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc79f2d0>
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_613f1ab5ba42c04a88787f715f395a2d.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_613f1ab5ba42c04a88787f715f395a2d.jpg saved to cache
2026-03-30 11:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8d8d90>
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F28%252F3a28ba3bd342ccc06af1fe3d76c4c085%252Fpa%252FSG06141_5dd8556de5b781e0fbdff78bdd255d39.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5dd8556de5b781e0fbdff78bdd255d39.jpg saved to cache
2026-03-30 11:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51728403-42b7-56d6-b559-d250dc716f96
2026-03-30 11:47:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51728403-42b7-56d6-b559-d250dc716f96, skipping ID generation
2026-03-30 11:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51728403-42b7-56d6-b559-d250dc716f96 with scrape type 1
2026-03-30 11:47:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51728403-42b7-56d6-b559-d250dc716f96 sending to next pipeline
2026-03-30 11:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51728403-42b7-56d6-b559-d250dc716f96, identifier: SG06141
2026-03-30 11:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51728403-42b7-56d6-b559-d250dc716f96 with identifier: SG06141
2026-03-30 11:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51728403-42b7-56d6-b559-d250dc716f96 with identifier: SG06141
2026-03-30 11:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51728403-42b7-56d6-b559-d250dc716f96 with identifier: SG06141 to the API
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5dd8556de5b781e0fbdff78bdd255d39.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:35:37Z',
 'fuel_type': 'petrol',
 'id': '51728403-42b7-56d6-b559-d250dc716f96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG06141',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 186485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2649042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5dd8556de5b781e0fbdff78bdd255d39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_5ce72fa8659b36a767cc6368430e82c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_613f1ab5ba42c04a88787f715f395a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2236010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_a1961d39f983bb6df25f122bcfe35fce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_11cc8044486f9741ffd15b6f0fe23216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_31faf77850a1df3ceca66d40d821e5e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_368d5d1547282cc1ed3d400f8d7c4837.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_d5ded744d6a7792b145f2994b2ccf875.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_b6846e90ef7efbc534e028ec4a3251fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51728403-42b7-56d6-b559-d250dc716f96/51728403-42b7-56d6-b559-d250dc716f96_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2439831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/28/3a28ba3bd342ccc06af1fe3d76c4c085/pa/SG06141_8cff16042b188441f659260c210f07bc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2016}
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG06141%27 HTTP/1.1" 200 None
2026-03-30 11:47:22 [auto1.be] INFO: Saving data for SG06141: {'created_time': 1774871242.725902, 'last_price_update_time': 1774871242.725914, 'auction_closing_time': 1774971337.0}
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG06141') HTTP/1.1" 204 0
2026-03-30 11:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW08059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP63319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK60996> (referer: https://www.auto1.com/v1/car-details-view/XK60996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79c17303-0131-5035-a58c-565bcbe82603 with identifier: XK60996
2026-03-30 11:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79c17303-0131-5035-a58c-565bcbe82603 with scrape type 1
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_6a633ea22e5a607de356e1d49420b32e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_6a633ea22e5a607de356e1d49420b32e.jpg not downloaded yet
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_2c817ce60f65497c463dc1526252ca02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_2c817ce60f65497c463dc1526252ca02.jpg not downloaded yet
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_a20716c2c2c10e84625c524b8591b1e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a20716c2c2c10e84625c524b8591b1e9.jpg not downloaded yet
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_f57792ba1940248de17752bd92ce2e90.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_f57792ba1940248de17752bd92ce2e90.jpg not downloaded yet
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_15e5d75f825a5a2e6475c2cda6927cfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_15e5d75f825a5a2e6475c2cda6927cfb.jpg not downloaded yet
2026-03-30 11:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_1a4adac3c42b92da761f32cf4573b9f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_1a4adac3c42b92da761f32cf4573b9f2.jpg not downloaded yet
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_2c817ce60f65497c463dc1526252ca02.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_a0aa910ebaf5f97bcb04fa8164bcdbd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a0aa910ebaf5f97bcb04fa8164bcdbd7.jpg not downloaded yet
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_6a633ea22e5a607de356e1d49420b32e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_0a9c3644f16155f5644eeabe25c1a8e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_0a9c3644f16155f5644eeabe25c1a8e5.jpg not downloaded yet
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_28d2d2c6b772fb14bf042331c1c86f46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_28d2d2c6b772fb14bf042331c1c86f46.jpg not downloaded yet
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_d76f6f795f4c83809fcec86fdebc914e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_d76f6f795f4c83809fcec86fdebc914e.jpg not downloaded yet
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_f57792ba1940248de17752bd92ce2e90.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:24 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1764 | hits on page: 40
2026-03-30 11:47:24 [auto1.be] INFO: Found listing with ID: AS78101
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS78101%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.be] INFO: Scrape type for AS78101: 1
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD22727> (referer: https://www.auto1.com/v1/car-details-view/XD22727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_1a4adac3c42b92da761f32cf4573b9f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:24 [auto1.be] INFO: Found listing with ID: CV32851
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV32851%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.be] INFO: Scrape type for CV32851: 1
2026-03-30 11:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a0aa910ebaf5f97bcb04fa8164bcdbd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:24 [auto1.be] INFO: Found listing with ID: AA45434
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA45434%27 HTTP/1.1" 200 None
2026-03-30 11:47:24 [auto1.be] INFO: Scrape type for AA45434: 2
2026-03-30 11:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77698f49-561c-5218-857a-af1abbaac437 with identifier: AA45434
2026-03-30 11:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77698f49-561c-5218-857a-af1abbaac437 with scrape type 2
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77698f49-561c-5218-857a-af1abbaac437 with scrape type 2
2026-03-30 11:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77698f49-561c-5218-857a-af1abbaac437, identifier: AA45434
2026-03-30 11:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca505d0>
2026-03-30 11:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_2c817ce60f65497c463dc1526252ca02.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_2c817ce60f65497c463dc1526252ca02.jpg saved to cache
2026-03-30 11:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77698f49-561c-5218-857a-af1abbaac437 with identifier: AA45434
2026-03-30 11:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77698f49-561c-5218-857a-af1abbaac437 with identifier: AA45434
2026-03-30 11:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77698f49-561c-5218-857a-af1abbaac437 with identifier: AA45434 to the API
2026-03-30 11:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:40:58Z',
 'fuel_type': 'diesel',
 'id': '77698f49-561c-5218-857a-af1abbaac437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA45434',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 198922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-06',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2015}
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA45434%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [auto1.be] INFO: Saving data for AA45434: {'auction_closing_time': 1774971658.0, 'created_time': 1774125511.126296, 'last_price_update_time': 1774871245.223084}
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AA45434') HTTP/1.1" 204 0
2026-03-30 11:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_28d2d2c6b772fb14bf042331c1c86f46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: SF91035
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF91035%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [auto1.be] INFO: Scrape type for SF91035: 1
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca66450>
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_6a633ea22e5a607de356e1d49420b32e.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_6a633ea22e5a607de356e1d49420b32e.jpg saved to cache
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: HA52655
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: MP60001
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP60001%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [auto1.be] INFO: Scrape type for MP60001: 1
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8d8c50>
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_f57792ba1940248de17752bd92ce2e90.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_f57792ba1940248de17752bd92ce2e90.jpg saved to cache
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29c498df-6f07-55a1-98f0-21e8d551212c with identifier: XD22727
2026-03-30 11:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c498df-6f07-55a1-98f0-21e8d551212c with scrape type 1
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_55c564e8422222940a2e9b80f326c583.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_55c564e8422222940a2e9b80f326c583.jpg not downloaded yet
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc715c10>
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_1a4adac3c42b92da761f32cf4573b9f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_1a4adac3c42b92da761f32cf4573b9f2.jpg saved to cache
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc871290>
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_a0aa910ebaf5f97bcb04fa8164bcdbd7.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a0aa910ebaf5f97bcb04fa8164bcdbd7.jpg saved to cache
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: JZ66091
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ66091%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [auto1.be] INFO: Scrape type for JZ66091: 1
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_40a7a3cf03ba8ed7c8d95198e91ca8c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_40a7a3cf03ba8ed7c8d95198e91ca8c9.jpg not downloaded yet
2026-03-30 11:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_d76f6f795f4c83809fcec86fdebc914e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: TC22356
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: FX96878
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: AP57760
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP57760%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [auto1.be] INFO: Scrape type for AP57760: 1
2026-03-30 11:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS39251> (referer: https://www.auto1.com/v1/car-details-view/TS39251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc724950>
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_28d2d2c6b772fb14bf042331c1c86f46.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_28d2d2c6b772fb14bf042331c1c86f46.jpg saved to cache
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_c48a396358645c1ef731eacef2293a76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_c48a396358645c1ef731eacef2293a76.jpg not downloaded yet
2026-03-30 11:47:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:25 [auto1.be] INFO: Found listing with ID: KX38025
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX38025%27 HTTP/1.1" 200 None
2026-03-30 11:47:25 [auto1.be] INFO: Scrape type for KX38025: 2
2026-03-30 11:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047bd087-53cf-542b-9368-a26c15d99dbb with identifier: KX38025
2026-03-30 11:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047bd087-53cf-542b-9368-a26c15d99dbb with scrape type 2
2026-03-30 11:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047bd087-53cf-542b-9368-a26c15d99dbb with scrape type 2
2026-03-30 11:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 047bd087-53cf-542b-9368-a26c15d99dbb, identifier: KX38025
2026-03-30 11:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 047bd087-53cf-542b-9368-a26c15d99dbb with identifier: KX38025
2026-03-30 11:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 047bd087-53cf-542b-9368-a26c15d99dbb with identifier: KX38025
2026-03-30 11:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 047bd087-53cf-542b-9368-a26c15d99dbb with identifier: KX38025 to the API
2026-03-30 11:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-31T15:30:05Z',
 'fuel_type': 'hybrid',
 'id': '047bd087-53cf-542b-9368-a26c15d99dbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX38025',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 68323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P300e Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2021}
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX38025%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [auto1.be] INFO: Saving data for KX38025: {'auction_closing_time': 1774971005.0, 'created_time': 1774265802.694456, 'last_price_update_time': 1774871246.12669}
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX38025') HTTP/1.1" 204 0
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_e3b457d1ba13bf061953350b38a944d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e3b457d1ba13bf061953350b38a944d5.jpg not downloaded yet
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: UY15914
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY15914%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [auto1.be] INFO: Scrape type for UY15914: 1
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_3937aa3e3f899ceff27451f229e5233f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_3937aa3e3f899ceff27451f229e5233f.jpg not downloaded yet
2026-03-30 11:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc798b90>
2026-03-30 11:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_d76f6f795f4c83809fcec86fdebc914e.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_d76f6f795f4c83809fcec86fdebc914e.jpg saved to cache
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b3492d5-cc06-5cb8-a7a2-66baf8d67693 with identifier: TS39251
2026-03-30 11:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3492d5-cc06-5cb8-a7a2-66baf8d67693 with scrape type 1
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b3492d5-cc06-5cb8-a7a2-66baf8d67693
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_edd6b2006d742b6ed163b1caee4982d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_edd6b2006d742b6ed163b1caee4982d4.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_0f37d47ed87aedfa09b4f280b3b05e9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_0f37d47ed87aedfa09b4f280b3b05e9f.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_73f9200142482c7bbfae0930b8df264a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_73f9200142482c7bbfae0930b8df264a.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_b1e374558bdcae0961b693acb4ca18f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_b1e374558bdcae0961b693acb4ca18f6.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_75468e1a3d77aa188ed92adec79860d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_75468e1a3d77aa188ed92adec79860d3.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_ff3afcde785c4b99193755b2dbf6301f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_ff3afcde785c4b99193755b2dbf6301f.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_27311172b7b0dbb60afe0afae5bfcd1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_27311172b7b0dbb60afe0afae5bfcd1f.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_98426c44126cc65ee4b816bc6e286dc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_98426c44126cc65ee4b816bc6e286dc1.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_77acdfcf74d3fc3607d771ef384079da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_77acdfcf74d3fc3607d771ef384079da.jpg already downloaded
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc1%252F61c1aaca5e253033132bcb9220d645fa%252Fpa%252FTS39251_07aed3476d03ea0437cb96e68971a86c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_07aed3476d03ea0437cb96e68971a86c.jpg already downloaded
2026-03-30 11:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b3492d5-cc06-5cb8-a7a2-66baf8d67693, identifier: TS39251
2026-03-30 11:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_40a7a3cf03ba8ed7c8d95198e91ca8c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: MD90216
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD90216%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [auto1.be] INFO: Scrape type for MD90216: 1
2026-03-30 11:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b3492d5-cc06-5cb8-a7a2-66baf8d67693 with identifier: TS39251
2026-03-30 11:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b3492d5-cc06-5cb8-a7a2-66baf8d67693 with identifier: TS39251
2026-03-30 11:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b3492d5-cc06-5cb8-a7a2-66baf8d67693 with identifier: TS39251 to the API
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS39251>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:43:51Z',
 'fuel_type': 'diesel',
 'id': '5b3492d5-cc06-5cb8-a7a2-66baf8d67693',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS39251',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 73940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_edd6b2006d742b6ed163b1caee4982d4.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_0f37d47ed87aedfa09b4f280b3b05e9f.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_73f9200142482c7bbfae0930b8df264a.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_b1e374558bdcae0961b693acb4ca18f6.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_75468e1a3d77aa188ed92adec79860d3.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_ff3afcde785c4b99193755b2dbf6301f.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_27311172b7b0dbb60afe0afae5bfcd1f.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_98426c44126cc65ee4b816bc6e286dc1.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_77acdfcf74d3fc3607d771ef384079da.jpg',
                'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_07aed3476d03ea0437cb96e68971a86c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_edd6b2006d742b6ed163b1caee4982d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_0f37d47ed87aedfa09b4f280b3b05e9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_73f9200142482c7bbfae0930b8df264a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_b1e374558bdcae0961b693acb4ca18f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_75468e1a3d77aa188ed92adec79860d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_ff3afcde785c4b99193755b2dbf6301f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_27311172b7b0dbb60afe0afae5bfcd1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_98426c44126cc65ee4b816bc6e286dc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_77acdfcf74d3fc3607d771ef384079da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3492d5-cc06-5cb8-a7a2-66baf8d67693/5b3492d5-cc06-5cb8-a7a2-66baf8d67693_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c1/61c1aaca5e253033132bcb9220d645fa/pa/TS39251_07aed3476d03ea0437cb96e68971a86c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'manual',
 'trim': 'BlueTEC AMG Line',
 'year': 2017}
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS39251%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [auto1.be] INFO: Saving data for TS39251: {'created_time': 1774871246.909047, 'last_price_update_time': 1774871246.909059, 'auction_closing_time': 1774971831.0}
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS39251') HTTP/1.1" 204 0
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_d402b3ba2604a445f6ecbb5920b617c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_d402b3ba2604a445f6ecbb5920b617c1.jpg not downloaded yet
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: XZ36131
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ36131%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [auto1.be] INFO: Scrape type for XZ36131: 1
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_e2b3baf067830d7bfdc8d30e29bda723.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e2b3baf067830d7bfdc8d30e29bda723.jpg not downloaded yet
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: TW96115
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: XP64543
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: FK03053
2026-03-30 11:47:26 [auto1.be] INFO: Found listing with ID: AC52442
2026-03-30 11:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC52442%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [auto1.be] INFO: Scrape type for AC52442: 1
2026-03-30 11:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb133d0>
2026-03-30 11:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_40a7a3cf03ba8ed7c8d95198e91ca8c9.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_40a7a3cf03ba8ed7c8d95198e91ca8c9.jpg saved to cache
2026-03-30 11:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_261ab7df2b8786a536a62989bce0aca4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_261ab7df2b8786a536a62989bce0aca4.jpg not downloaded yet
2026-03-30 11:47:27 [auto1.be] INFO: Found listing with ID: KT25789
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT25789%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [auto1.be] INFO: Scrape type for KT25789: 1
2026-03-30 11:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_3937aa3e3f899ceff27451f229e5233f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_65cd98c69d44f9112a1065be593d1196.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_65cd98c69d44f9112a1065be593d1196.jpg not downloaded yet
2026-03-30 11:47:27 [auto1.be] INFO: Found listing with ID: UZ91497
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ91497%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [auto1.be] INFO: Scrape type for UZ91497: 2
2026-03-30 11:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660ad917-2a25-565c-ab78-7bbaba2ad04f with identifier: UZ91497
2026-03-30 11:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660ad917-2a25-565c-ab78-7bbaba2ad04f with scrape type 2
2026-03-30 11:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 660ad917-2a25-565c-ab78-7bbaba2ad04f with scrape type 2
2026-03-30 11:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 660ad917-2a25-565c-ab78-7bbaba2ad04f, identifier: UZ91497
2026-03-30 11:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 660ad917-2a25-565c-ab78-7bbaba2ad04f with identifier: UZ91497
2026-03-30 11:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 660ad917-2a25-565c-ab78-7bbaba2ad04f with identifier: UZ91497
2026-03-30 11:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 660ad917-2a25-565c-ab78-7bbaba2ad04f with identifier: UZ91497 to the API
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:01:46Z',
 'fuel_type': 'diesel',
 'id': '660ad917-2a25-565c-ab78-7bbaba2ad04f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ91497',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 225712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2012}
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ91497%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [auto1.be] INFO: Saving data for UZ91497: {'auction_closing_time': 1774969306.0, 'created_time': 1773131979.631237, 'last_price_update_time': 1774871247.5995}
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ91497') HTTP/1.1" 204 0
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_41da4fcc5cd63ea4debd91d1553b1ec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_41da4fcc5cd63ea4debd91d1553b1ec2.jpg not downloaded yet
2026-03-30 11:47:27 [auto1.be] INFO: Found listing with ID: VA10868
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA10868%27 HTTP/1.1" 200 None
2026-03-30 11:47:27 [auto1.be] INFO: Scrape type for VA10868: 2
2026-03-30 11:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b3bae9f-0d8d-5b05-bf8d-6f388167daa8 with identifier: VA10868
2026-03-30 11:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b3bae9f-0d8d-5b05-bf8d-6f388167daa8 with scrape type 2
2026-03-30 11:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b3bae9f-0d8d-5b05-bf8d-6f388167daa8 with scrape type 2
2026-03-30 11:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b3bae9f-0d8d-5b05-bf8d-6f388167daa8, identifier: VA10868
2026-03-30 11:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b3bae9f-0d8d-5b05-bf8d-6f388167daa8 with identifier: VA10868
2026-03-30 11:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b3bae9f-0d8d-5b05-bf8d-6f388167daa8 with identifier: VA10868
2026-03-30 11:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b3bae9f-0d8d-5b05-bf8d-6f388167daa8 with identifier: VA10868 to the API
2026-03-30 11:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:02:21Z',
 'fuel_type': 'diesel',
 'id': '1b3bae9f-0d8d-5b05-bf8d-6f388167daa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA10868',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 252726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-24',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2013}
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA10868%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Saving data for VA10868: {'auction_closing_time': 1774969341.0, 'created_time': 1774125332.540779, 'last_price_update_time': 1774871248.167117}
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA10868') HTTP/1.1" 204 0
2026-03-30 11:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_261ab7df2b8786a536a62989bce0aca4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: UP32209
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UP32209%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for UP32209: 1
2026-03-30 11:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK88791> (referer: https://www.auto1.com/v1/car-details-view/WK88791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc903e10>
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_3937aa3e3f899ceff27451f229e5233f.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_3937aa3e3f899ceff27451f229e5233f.jpg saved to cache
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: SL82262
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL82262%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for SL82262: 1
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: YK50481
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK50481%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for YK50481: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for TG38013: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: VV61440
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: SX17712
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX17712%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for SX17712: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for CK64923: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: DD41126
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD41126%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for DD41126: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: HL85042
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL85042%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for HL85042: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: WR16749
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR16749%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for WR16749: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: DJ32328
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: NS39608
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS39608%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for NS39608: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: FE21102
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: KP84190
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: JM82997
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM82997%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for JM82997: 0
2026-03-30 11:47:28 [auto1.be] INFO: Found listing with ID: EH30324
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH30324%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [auto1.be] INFO: Scrape type for EH30324: 0
2026-03-30 11:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_41da4fcc5cd63ea4debd91d1553b1ec2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5bc790>
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_261ab7df2b8786a536a62989bce0aca4.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_261ab7df2b8786a536a62989bce0aca4.jpg saved to cache
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9204301e-6ced-5bfe-a5ce-23bdc3b939ab with identifier: WK88791
2026-03-30 11:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab with scrape type 1
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_2bc6abb75f7741a0786d0c1f90e4aedd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_2bc6abb75f7741a0786d0c1f90e4aedd.jpg not downloaded yet
2026-03-30 11:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_65cd98c69d44f9112a1065be593d1196.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_cdc8d3453530be07a29053b8955c455f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_cdc8d3453530be07a29053b8955c455f.jpg not downloaded yet
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_e2bf804068f50357bfdb219e6f1a83c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e2bf804068f50357bfdb219e6f1a83c5.jpg not downloaded yet
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_3e495e46d48fa9ca898e6c7d5912ab55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_3e495e46d48fa9ca898e6c7d5912ab55.jpg not downloaded yet
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78cf90>
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_41da4fcc5cd63ea4debd91d1553b1ec2.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_41da4fcc5cd63ea4debd91d1553b1ec2.jpg saved to cache
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_e59d7c4bad14f518234ae65a75838757.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e59d7c4bad14f518234ae65a75838757.jpg not downloaded yet
2026-03-30 11:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_2bc6abb75f7741a0786d0c1f90e4aedd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_79a334b17608265197775e7c7a807633.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_79a334b17608265197775e7c7a807633.jpg not downloaded yet
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_474f8b4c86fbcd311d23abfd65a3c757.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_474f8b4c86fbcd311d23abfd65a3c757.jpg not downloaded yet
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc794310>
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_65cd98c69d44f9112a1065be593d1196.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_65cd98c69d44f9112a1065be593d1196.jpg saved to cache
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_e721268bcd98315dd97681f04fe0032e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e721268bcd98315dd97681f04fe0032e.jpg not downloaded yet
2026-03-30 11:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_3e495e46d48fa9ca898e6c7d5912ab55.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_286cd8cbd4ad1600ee92d3681fa11978.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_286cd8cbd4ad1600ee92d3681fa11978.jpg not downloaded yet
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_9af68b510fa7ddc6e67f8e6b6dc6a3bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_9af68b510fa7ddc6e67f8e6b6dc6a3bd.jpg not downloaded yet
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9a4e50>
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_2bc6abb75f7741a0786d0c1f90e4aedd.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_2bc6abb75f7741a0786d0c1f90e4aedd.jpg saved to cache
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f5810>
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_3e495e46d48fa9ca898e6c7d5912ab55.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_3e495e46d48fa9ca898e6c7d5912ab55.jpg saved to cache
2026-03-30 11:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_474f8b4c86fbcd311d23abfd65a3c757.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_9af68b510fa7ddc6e67f8e6b6dc6a3bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca3d2d0>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_474f8b4c86fbcd311d23abfd65a3c757.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_474f8b4c86fbcd311d23abfd65a3c757.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_286cd8cbd4ad1600ee92d3681fa11978.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca4e910>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_9af68b510fa7ddc6e67f8e6b6dc6a3bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_9af68b510fa7ddc6e67f8e6b6dc6a3bd.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e721268bcd98315dd97681f04fe0032e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7770d0>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_286cd8cbd4ad1600ee92d3681fa11978.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_286cd8cbd4ad1600ee92d3681fa11978.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_79a334b17608265197775e7c7a807633.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc700a90>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_e721268bcd98315dd97681f04fe0032e.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e721268bcd98315dd97681f04fe0032e.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e59d7c4bad14f518234ae65a75838757.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7bba90>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_79a334b17608265197775e7c7a807633.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_79a334b17608265197775e7c7a807633.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e2bf804068f50357bfdb219e6f1a83c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5bc810>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_e59d7c4bad14f518234ae65a75838757.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e59d7c4bad14f518234ae65a75838757.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_cdc8d3453530be07a29053b8955c455f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dd735ed0>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_e2bf804068f50357bfdb219e6f1a83c5.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e2bf804068f50357bfdb219e6f1a83c5.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9a7c10>
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fd6%252F93d6300528ced40ea5259ac6319e38d7%252Fpa%252FWK88791_cdc8d3453530be07a29053b8955c455f.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_cdc8d3453530be07a29053b8955c455f.jpg saved to cache
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab
2026-03-30 11:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9204301e-6ced-5bfe-a5ce-23bdc3b939ab, skipping ID generation
2026-03-30 11:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab with scrape type 1
2026-03-30 11:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9204301e-6ced-5bfe-a5ce-23bdc3b939ab sending to next pipeline
2026-03-30 11:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9204301e-6ced-5bfe-a5ce-23bdc3b939ab, identifier: WK88791
2026-03-30 11:47:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9204301e-6ced-5bfe-a5ce-23bdc3b939ab with identifier: WK88791
2026-03-30 11:47:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9204301e-6ced-5bfe-a5ce-23bdc3b939ab with identifier: WK88791
2026-03-30 11:47:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9204301e-6ced-5bfe-a5ce-23bdc3b939ab with identifier: WK88791 to the API
2026-03-30 11:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_cdc8d3453530be07a29053b8955c455f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:39:53Z',
 'fuel_type': 'petrol',
 'id': '9204301e-6ced-5bfe-a5ce-23bdc3b939ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK88791',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 142393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_2bc6abb75f7741a0786d0c1f90e4aedd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_cdc8d3453530be07a29053b8955c455f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e2bf804068f50357bfdb219e6f1a83c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_3e495e46d48fa9ca898e6c7d5912ab55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e59d7c4bad14f518234ae65a75838757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_79a334b17608265197775e7c7a807633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_474f8b4c86fbcd311d23abfd65a3c757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_e721268bcd98315dd97681f04fe0032e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_286cd8cbd4ad1600ee92d3681fa11978.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9204301e-6ced-5bfe-a5ce-23bdc3b939ab/9204301e-6ced-5bfe-a5ce-23bdc3b939ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/d6/93d6300528ced40ea5259ac6319e38d7/pa/WK88791_9af68b510fa7ddc6e67f8e6b6dc6a3bd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-30 11:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK88791%27 HTTP/1.1" 200 None
2026-03-30 11:47:30 [auto1.be] INFO: Saving data for WK88791: {'created_time': 1774871250.29356, 'last_price_update_time': 1774871250.293572, 'auction_closing_time': 1774971593.0}
2026-03-30 11:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK88791') HTTP/1.1" 204 0
2026-03-30 11:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP81056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD12603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.054(s), this was the 1st time calling it.
2026-03-30 11:47:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.393167513236828 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW43173> (referer: https://www.auto1.com/v1/car-details-view/HW43173/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce5d404-9464-56fd-8ade-3be6080538d5 with identifier: HW43173
2026-03-30 11:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce5d404-9464-56fd-8ade-3be6080538d5 with scrape type 1
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ce5d404-9464-56fd-8ade-3be6080538d5
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_c096eb09a14079e64001927ef5da3a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_c096eb09a14079e64001927ef5da3a4a.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_e72746ff32e72f1993f5caf8f7501cac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_e72746ff32e72f1993f5caf8f7501cac.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_b9c46a310638f9aa6846139283636ef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_b9c46a310638f9aa6846139283636ef6.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_cb23a153fef4b12d63e0dc69ba7a4776.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_cb23a153fef4b12d63e0dc69ba7a4776.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_26d4fc8df61e939489e0e44df587f087.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_26d4fc8df61e939489e0e44df587f087.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_d55758620fb5fd1b6d5b19dc5f5fc5aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_d55758620fb5fd1b6d5b19dc5f5fc5aa.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_06f1f88def13f17c701e89c1a8cb02ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_06f1f88def13f17c701e89c1a8cb02ec.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_3d8bb0c313101f455b797d608bf547f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_3d8bb0c313101f455b797d608bf547f8.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_9578037bd5bb106981a47e861e042ee8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_9578037bd5bb106981a47e861e042ee8.jpg already downloaded
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F09%252F14091780c90088cdbf4af95617f07b21%252Fpa%252FHW43173_9f9634e9cb6f88e1c5804be245e1e806.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_9f9634e9cb6f88e1c5804be245e1e806.jpg already downloaded
2026-03-30 11:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ce5d404-9464-56fd-8ade-3be6080538d5, identifier: HW43173
2026-03-30 11:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ce5d404-9464-56fd-8ade-3be6080538d5 with identifier: HW43173
2026-03-30 11:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ce5d404-9464-56fd-8ade-3be6080538d5 with identifier: HW43173
2026-03-30 11:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ce5d404-9464-56fd-8ade-3be6080538d5 with identifier: HW43173 to the API
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW43173>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:50:33Z',
 'fuel_type': 'petrol',
 'id': '7ce5d404-9464-56fd-8ade-3be6080538d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW43173',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 151415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_c096eb09a14079e64001927ef5da3a4a.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_e72746ff32e72f1993f5caf8f7501cac.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_b9c46a310638f9aa6846139283636ef6.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_cb23a153fef4b12d63e0dc69ba7a4776.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_26d4fc8df61e939489e0e44df587f087.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_d55758620fb5fd1b6d5b19dc5f5fc5aa.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_06f1f88def13f17c701e89c1a8cb02ec.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_3d8bb0c313101f455b797d608bf547f8.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_9578037bd5bb106981a47e861e042ee8.jpg',
                'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_9f9634e9cb6f88e1c5804be245e1e806.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1939040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_c096eb09a14079e64001927ef5da3a4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2072820,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_e72746ff32e72f1993f5caf8f7501cac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_b9c46a310638f9aa6846139283636ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_cb23a153fef4b12d63e0dc69ba7a4776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_26d4fc8df61e939489e0e44df587f087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_d55758620fb5fd1b6d5b19dc5f5fc5aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_06f1f88def13f17c701e89c1a8cb02ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_3d8bb0c313101f455b797d608bf547f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_9578037bd5bb106981a47e861e042ee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce5d404-9464-56fd-8ade-3be6080538d5/7ce5d404-9464-56fd-8ade-3be6080538d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/09/14091780c90088cdbf4af95617f07b21/pa/HW43173_9f9634e9cb6f88e1c5804be245e1e806.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 T Executive',
 'transmission': 'manual',
 'trim': 'T Executive',
 'year': 2019}
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW43173%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [auto1.be] INFO: Saving data for HW43173: {'created_time': 1774871254.023742, 'last_price_update_time': 1774871254.023753, 'auction_closing_time': 1774972233.0}
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW43173') HTTP/1.1" 204 0
2026-03-30 11:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW08059> (referer: https://www.auto1.com/v1/car-details-view/MW08059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0b03cc2-0273-597c-9092-779d8ac3c613 with identifier: MW08059
2026-03-30 11:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0b03cc2-0273-597c-9092-779d8ac3c613 with scrape type 1
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0b03cc2-0273-597c-9092-779d8ac3c613
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_7f39a14a1b8f642e94670c852c175b11.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_7f39a14a1b8f642e94670c852c175b11.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_3ae706e3c591a29d3a2470cf33076822.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_3ae706e3c591a29d3a2470cf33076822.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_1a1597824437c1c3d02f91519fd33df0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_1a1597824437c1c3d02f91519fd33df0.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_2f8101c3550be84d8a6133767023ded8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_2f8101c3550be84d8a6133767023ded8.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_a5853e1387cb8dec16fe473625e0ec0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a5853e1387cb8dec16fe473625e0ec0d.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_a7401baae0740ccaad0c28870b1141ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a7401baae0740ccaad0c28870b1141ca.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_c978a44c7d20b9e4eadb8ecf2b6d2807.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_c978a44c7d20b9e4eadb8ecf2b6d2807.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_a7560e11ccb59fe15852d9ffa53882c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a7560e11ccb59fe15852d9ffa53882c5.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_68e5547697328a5f3baef0d8ab1741e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_68e5547697328a5f3baef0d8ab1741e2.jpg already downloaded
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F37%252F5337ddeb6bfd48a154fe2ea0075b4685%252Fpa%252FMW08059_2eb813d958d3dc60bf8d1199be5c2ce6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_2eb813d958d3dc60bf8d1199be5c2ce6.jpg already downloaded
2026-03-30 11:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0b03cc2-0273-597c-9092-779d8ac3c613, identifier: MW08059
2026-03-30 11:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0b03cc2-0273-597c-9092-779d8ac3c613 with identifier: MW08059
2026-03-30 11:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0b03cc2-0273-597c-9092-779d8ac3c613 with identifier: MW08059
2026-03-30 11:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0b03cc2-0273-597c-9092-779d8ac3c613 with identifier: MW08059 to the API
2026-03-30 11:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW08059>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:25:43Z',
 'fuel_type': 'diesel',
 'id': 'c0b03cc2-0273-597c-9092-779d8ac3c613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW08059',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 82828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_7f39a14a1b8f642e94670c852c175b11.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_3ae706e3c591a29d3a2470cf33076822.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_1a1597824437c1c3d02f91519fd33df0.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_2f8101c3550be84d8a6133767023ded8.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a5853e1387cb8dec16fe473625e0ec0d.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a7401baae0740ccaad0c28870b1141ca.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_c978a44c7d20b9e4eadb8ecf2b6d2807.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a7560e11ccb59fe15852d9ffa53882c5.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_68e5547697328a5f3baef0d8ab1741e2.jpg',
                'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_2eb813d958d3dc60bf8d1199be5c2ce6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_7f39a14a1b8f642e94670c852c175b11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_3ae706e3c591a29d3a2470cf33076822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_1a1597824437c1c3d02f91519fd33df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_2f8101c3550be84d8a6133767023ded8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a5853e1387cb8dec16fe473625e0ec0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1963974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a7401baae0740ccaad0c28870b1141ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1678780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_c978a44c7d20b9e4eadb8ecf2b6d2807.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1943482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_a7560e11ccb59fe15852d9ffa53882c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_68e5547697328a5f3baef0d8ab1741e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0b03cc2-0273-597c-9092-779d8ac3c613/c0b03cc2-0273-597c-9092-779d8ac3c613_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/37/5337ddeb6bfd48a154fe2ea0075b4685/pa/MW08059_2eb813d958d3dc60bf8d1199be5c2ce6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 16d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW08059%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Saving data for MW08059: {'created_time': 1774871255.227627, 'last_price_update_time': 1774871255.227639, 'auction_closing_time': 1774970743.0}
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW08059') HTTP/1.1" 204 0
2026-03-30 11:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:35 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1764 | hits on page: 40
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: ME19194
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME19194%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for ME19194: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: XM81929
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM81929%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for XM81929: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: RL35333
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL35333%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for RL35333: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: WD23717
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for DZ54195: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for PB88221: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: VP17023
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: CF49225
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: ST59109
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST59109%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for ST59109: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: HA15365
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: NN50309
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN50309%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for NN50309: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: RD52510
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD52510%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for RD52510: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for XT14784: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: AV31741
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: RJ26699
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: FL94389
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: MX59641
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: EW88607
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: JH90909
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: UT07561
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT07561%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for UT07561: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: GN58348
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: XW45158
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW45158%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for XW45158: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: SE67148
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: KP55338
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP55338%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for KP55338: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: ME39543
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: RN25296
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN25296%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.be] INFO: Scrape type for RN25296: 0
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: CD49334
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: SG70291
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: EU38310
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: NL96046
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-30 11:47:35 [auto1.be] INFO: Found listing with ID: GL12776
2026-03-30 11:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e2b3baf067830d7bfdc8d30e29bda723.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc884ad0>
2026-03-30 11:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_e2b3baf067830d7bfdc8d30e29bda723.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e2b3baf067830d7bfdc8d30e29bda723.jpg saved to cache
2026-03-30 11:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS78101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV32851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF90944> (referer: https://www.auto1.com/v1/car-details-view/DF90944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_d402b3ba2604a445f6ecbb5920b617c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e24b0442-de4e-5f10-8114-4c88dd820046 with identifier: DF90944
2026-03-30 11:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e24b0442-de4e-5f10-8114-4c88dd820046 with scrape type 1
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e24b0442-de4e-5f10-8114-4c88dd820046
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_20cdf078624f5e0cf8db79197aec1460.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_20cdf078624f5e0cf8db79197aec1460.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_ade6c470a302e654a77b40c3c9c75aa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_ade6c470a302e654a77b40c3c9c75aa6.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_497c7d63f1478f948641e7ec9e01614a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_497c7d63f1478f948641e7ec9e01614a.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_c6ab1dd9227100083e2261b063103f6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_c6ab1dd9227100083e2261b063103f6b.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_0201f3c7f4040fe2a9f7603b9300f9ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_0201f3c7f4040fe2a9f7603b9300f9ac.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_91d0bd0aa8158c744e85acf18ea1cb06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_91d0bd0aa8158c744e85acf18ea1cb06.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_b307aac3eb9cec1cb4e18a5a015a742f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_b307aac3eb9cec1cb4e18a5a015a742f.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_3fe4b318301200b3251bedcb60d5c437.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_3fe4b318301200b3251bedcb60d5c437.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_eaab9d3e72b41d0df353aff2721c97be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_eaab9d3e72b41d0df353aff2721c97be.jpg already downloaded
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F55%252F4c55cb01099b57275a55ad3b6b999f59%252Fpa%252FDF90944_84040dc66c269d54e731e2392ea9b7d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_84040dc66c269d54e731e2392ea9b7d6.jpg already downloaded
2026-03-30 11:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e24b0442-de4e-5f10-8114-4c88dd820046, identifier: DF90944
2026-03-30 11:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e24b0442-de4e-5f10-8114-4c88dd820046 with identifier: DF90944
2026-03-30 11:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e24b0442-de4e-5f10-8114-4c88dd820046 with identifier: DF90944
2026-03-30 11:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e24b0442-de4e-5f10-8114-4c88dd820046 with identifier: DF90944 to the API
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF90944>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:50:04Z',
 'fuel_type': 'petrol',
 'id': 'e24b0442-de4e-5f10-8114-4c88dd820046',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF90944',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 40939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_20cdf078624f5e0cf8db79197aec1460.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_ade6c470a302e654a77b40c3c9c75aa6.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_497c7d63f1478f948641e7ec9e01614a.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_c6ab1dd9227100083e2261b063103f6b.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_0201f3c7f4040fe2a9f7603b9300f9ac.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_91d0bd0aa8158c744e85acf18ea1cb06.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_b307aac3eb9cec1cb4e18a5a015a742f.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_3fe4b318301200b3251bedcb60d5c437.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_eaab9d3e72b41d0df353aff2721c97be.jpg',
                'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_84040dc66c269d54e731e2392ea9b7d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_20cdf078624f5e0cf8db79197aec1460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_ade6c470a302e654a77b40c3c9c75aa6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2668045,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_497c7d63f1478f948641e7ec9e01614a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_c6ab1dd9227100083e2261b063103f6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_0201f3c7f4040fe2a9f7603b9300f9ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_91d0bd0aa8158c744e85acf18ea1cb06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_b307aac3eb9cec1cb4e18a5a015a742f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_3fe4b318301200b3251bedcb60d5c437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2706324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_eaab9d3e72b41d0df353aff2721c97be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e24b0442-de4e-5f10-8114-4c88dd820046/e24b0442-de4e-5f10-8114-4c88dd820046_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/55/4c55cb01099b57275a55ad3b6b999f59/pa/DF90944_84040dc66c269d54e731e2392ea9b7d6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2019}
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF90944%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [auto1.be] INFO: Saving data for DF90944: {'created_time': 1774871256.989455, 'last_price_update_time': 1774871256.989463, 'auction_closing_time': 1774972204.0}
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF90944') HTTP/1.1" 204 0
2026-03-30 11:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW35793> (referer: https://www.auto1.com/v1/car-details-view/GW35793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de7d9b10>
2026-03-30 11:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_d402b3ba2604a445f6ecbb5920b617c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_d402b3ba2604a445f6ecbb5920b617c1.jpg saved to cache
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29ded8d-69c8-511a-a619-a85fdfb55e2b with identifier: GW35793
2026-03-30 11:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29ded8d-69c8-511a-a619-a85fdfb55e2b with scrape type 1
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e29ded8d-69c8-511a-a619-a85fdfb55e2b
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_69ecc4ded5e1645e91d9e4b0f0c03ad7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_69ecc4ded5e1645e91d9e4b0f0c03ad7.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_533f713e23123310e7cc3a16a97b19ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_533f713e23123310e7cc3a16a97b19ce.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_cb9ab0111ec12b71daad3c9ac117481f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_cb9ab0111ec12b71daad3c9ac117481f.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_5e4aa368ae0752aa48c5c57aa73e52ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_5e4aa368ae0752aa48c5c57aa73e52ad.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_1de36462e713ba1aebe6c5c1116aa136.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_1de36462e713ba1aebe6c5c1116aa136.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_7fc65142643962797d721629722417ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_7fc65142643962797d721629722417ce.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_e432d612c0a602c94b9eea7df34d52d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_e432d612c0a602c94b9eea7df34d52d4.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_1a19e622a43dc2e8a90be822b2fc8fb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_1a19e622a43dc2e8a90be822b2fc8fb9.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_397367209e33910a0998cf5bab50f762.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_397367209e33910a0998cf5bab50f762.jpg already downloaded
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F64%252F1564bb1fc312ad1d1e537099ca66b741%252Fpa%252FGW35793_8de551be914b11ed1112b01423a20232.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_8de551be914b11ed1112b01423a20232.jpg already downloaded
2026-03-30 11:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e29ded8d-69c8-511a-a619-a85fdfb55e2b, identifier: GW35793
2026-03-30 11:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e29ded8d-69c8-511a-a619-a85fdfb55e2b with identifier: GW35793
2026-03-30 11:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e29ded8d-69c8-511a-a619-a85fdfb55e2b with identifier: GW35793
2026-03-30 11:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e29ded8d-69c8-511a-a619-a85fdfb55e2b with identifier: GW35793 to the API
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW35793>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:12:29Z',
 'fuel_type': 'petrol',
 'id': 'e29ded8d-69c8-511a-a619-a85fdfb55e2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW35793',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Citroen',
 'model': 'C4 Spacetourer',
 'odometer': 125100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_69ecc4ded5e1645e91d9e4b0f0c03ad7.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_533f713e23123310e7cc3a16a97b19ce.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_cb9ab0111ec12b71daad3c9ac117481f.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_5e4aa368ae0752aa48c5c57aa73e52ad.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_1de36462e713ba1aebe6c5c1116aa136.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_7fc65142643962797d721629722417ce.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_e432d612c0a602c94b9eea7df34d52d4.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_1a19e622a43dc2e8a90be822b2fc8fb9.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_397367209e33910a0998cf5bab50f762.jpg',
                'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_8de551be914b11ed1112b01423a20232.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_69ecc4ded5e1645e91d9e4b0f0c03ad7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_533f713e23123310e7cc3a16a97b19ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_cb9ab0111ec12b71daad3c9ac117481f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_5e4aa368ae0752aa48c5c57aa73e52ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_1de36462e713ba1aebe6c5c1116aa136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_7fc65142643962797d721629722417ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_e432d612c0a602c94b9eea7df34d52d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_1a19e622a43dc2e8a90be822b2fc8fb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_397367209e33910a0998cf5bab50f762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29ded8d-69c8-511a-a619-a85fdfb55e2b/e29ded8d-69c8-511a-a619-a85fdfb55e2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/64/1564bb1fc312ad1d1e537099ca66b741/pa/GW35793_8de551be914b11ed1112b01423a20232.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Spacetourer 1.2 PureTech Origins',
 'transmission': 'manual',
 'trim': 'Origins',
 'year': 2019}
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW35793%27 HTTP/1.1" 200 None
2026-03-30 11:47:37 [auto1.be] INFO: Saving data for GW35793: {'created_time': 1774871257.872631, 'last_price_update_time': 1774871257.872643, 'auction_closing_time': 1774969949.0}
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW35793') HTTP/1.1" 204 0
2026-03-30 11:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP63319> (referer: https://www.auto1.com/v1/car-details-view/BP63319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e62133cb-2894-5c7d-81ee-03219441c57d with identifier: BP63319
2026-03-30 11:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e62133cb-2894-5c7d-81ee-03219441c57d with scrape type 1
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_c07a3df52f99f47545cd26d5ffd69b1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_c07a3df52f99f47545cd26d5ffd69b1b.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_1ea13ebfa2fda64fe04b1dd304857185.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1ea13ebfa2fda64fe04b1dd304857185.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_1070687ac452351311e99c8f9782e97b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1070687ac452351311e99c8f9782e97b.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_42bbcc09cfb71a1744ce17fc700c9f7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_42bbcc09cfb71a1744ce17fc700c9f7f.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_39ddf5e12daf56bbdd852012e02c933a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_39ddf5e12daf56bbdd852012e02c933a.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_0cbf8e92d07348569117686d7c37f05e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_0cbf8e92d07348569117686d7c37f05e.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_3f6a7f4900a4bfc0329e7b2794a04706.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_3f6a7f4900a4bfc0329e7b2794a04706.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_879605a97fc720a20cf881ea5f0b2ce8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_879605a97fc720a20cf881ea5f0b2ce8.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_203dcb408840428a66f70020e3890c05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_203dcb408840428a66f70020e3890c05.jpg not downloaded yet
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_71b48d7fa8d9c631f2193e45cf328539.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_71b48d7fa8d9c631f2193e45cf328539.jpg not downloaded yet
2026-03-30 11:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP32209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_71b48d7fa8d9c631f2193e45cf328539.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_203dcb408840428a66f70020e3890c05.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de819b10>
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_71b48d7fa8d9c631f2193e45cf328539.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_71b48d7fa8d9c631f2193e45cf328539.jpg saved to cache
2026-03-30 11:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc79e550>
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_203dcb408840428a66f70020e3890c05.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_203dcb408840428a66f70020e3890c05.jpg saved to cache
2026-03-30 11:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL82262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_879605a97fc720a20cf881ea5f0b2ce8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_3f6a7f4900a4bfc0329e7b2794a04706.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78c450>
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_879605a97fc720a20cf881ea5f0b2ce8.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_879605a97fc720a20cf881ea5f0b2ce8.jpg saved to cache
2026-03-30 11:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0e950>
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_3f6a7f4900a4bfc0329e7b2794a04706.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_3f6a7f4900a4bfc0329e7b2794a04706.jpg saved to cache
2026-03-30 11:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT25789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC52442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_0cbf8e92d07348569117686d7c37f05e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_39ddf5e12daf56bbdd852012e02c933a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d9c10>
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_0cbf8e92d07348569117686d7c37f05e.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_0cbf8e92d07348569117686d7c37f05e.jpg saved to cache
2026-03-30 11:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d590>
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_39ddf5e12daf56bbdd852012e02c933a.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_39ddf5e12daf56bbdd852012e02c933a.jpg saved to cache
2026-03-30 11:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_42bbcc09cfb71a1744ce17fc700c9f7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:49 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1765 | hits on page: 40
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: GL12776
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: FA29131
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA29131%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for FA29131: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: MA67469
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA67469%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for MA67469: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: FL73906
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL73906%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for FL73906: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: TR13838
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR13838%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for TR13838: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: KL19623
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: LW89201
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW89201%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for LW89201: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: AG54530
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG54530%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for AG54530: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: UU73016
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU73016%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for UU73016: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: YG75749
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: FU28808
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: CX41368
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: BT12815
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT12815%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for BT12815: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: PY47802
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: RD37587
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for RV20515: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: SG64560
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: XL28387
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: XZ87385
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ87385%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for XZ87385: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: ZV23610
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: JT53562
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT53562%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for JT53562: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: FH19686
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH19686%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for FH19686: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: NH91226
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for RS16623: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for CD50328: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: LC68044
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: FM77705
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM77705%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for FM77705: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: TY33491
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY33491%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for TY33491: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: HA32985
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: TS76065
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS76065%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for TS76065: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: TK82832
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK82832%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for TK82832: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for YS75558: 0
2026-03-30 11:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1070687ac452351311e99c8f9782e97b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d8650>
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_42bbcc09cfb71a1744ce17fc700c9f7f.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_42bbcc09cfb71a1744ce17fc700c9f7f.jpg saved to cache
2026-03-30 11:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc700d10>
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_1070687ac452351311e99c8f9782e97b.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1070687ac452351311e99c8f9782e97b.jpg saved to cache
2026-03-30 11:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS78101> (referer: https://www.auto1.com/v1/car-details-view/AS78101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1ea13ebfa2fda64fe04b1dd304857185.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fac1b7b-ce5d-5cfb-acde-54517f38fac0 with identifier: AS78101
2026-03-30 11:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0 with scrape type 1
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_983b11b49cc66afd0e9e12152bfe4e9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_983b11b49cc66afd0e9e12152bfe4e9e.jpg not downloaded yet
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_5076507f8823d360612bf196c2120837.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5076507f8823d360612bf196c2120837.jpg not downloaded yet
2026-03-30 11:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_c07a3df52f99f47545cd26d5ffd69b1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_7884137187e42a4cf24fd0aa015fe10a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7884137187e42a4cf24fd0aa015fe10a.jpg not downloaded yet
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_6dece68e83f1bcbac6cf7f066b7b5966.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_6dece68e83f1bcbac6cf7f066b7b5966.jpg not downloaded yet
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_de1463814117eb381e9cb6c1c6f7a312.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_de1463814117eb381e9cb6c1c6f7a312.jpg not downloaded yet
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83f810>
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_1ea13ebfa2fda64fe04b1dd304857185.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1ea13ebfa2fda64fe04b1dd304857185.jpg saved to cache
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_a35d4d5774758c5cdda93a55480ea7d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_a35d4d5774758c5cdda93a55480ea7d3.jpg not downloaded yet
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_7711342194de11bb0b22e2d07a392fd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7711342194de11bb0b22e2d07a392fd0.jpg not downloaded yet
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca87c50>
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F14%252F8714c1dc99fe2adbeaa73354475df346%252Fpa%252FBP63319_c07a3df52f99f47545cd26d5ffd69b1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_c07a3df52f99f47545cd26d5ffd69b1b.jpg saved to cache
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e62133cb-2894-5c7d-81ee-03219441c57d
2026-03-30 11:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e62133cb-2894-5c7d-81ee-03219441c57d, skipping ID generation
2026-03-30 11:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e62133cb-2894-5c7d-81ee-03219441c57d with scrape type 1
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e62133cb-2894-5c7d-81ee-03219441c57d sending to next pipeline
2026-03-30 11:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e62133cb-2894-5c7d-81ee-03219441c57d, identifier: BP63319
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_7bca3fec937160f6b938ecac6514c698.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7bca3fec937160f6b938ecac6514c698.jpg not downloaded yet
2026-03-30 11:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e62133cb-2894-5c7d-81ee-03219441c57d with identifier: BP63319
2026-03-30 11:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e62133cb-2894-5c7d-81ee-03219441c57d with identifier: BP63319
2026-03-30 11:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e62133cb-2894-5c7d-81ee-03219441c57d with identifier: BP63319 to the API
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_c07a3df52f99f47545cd26d5ffd69b1b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:36:15Z',
 'fuel_type': 'petrol',
 'id': 'e62133cb-2894-5c7d-81ee-03219441c57d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP63319',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 158650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_c07a3df52f99f47545cd26d5ffd69b1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1ea13ebfa2fda64fe04b1dd304857185.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_1070687ac452351311e99c8f9782e97b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_42bbcc09cfb71a1744ce17fc700c9f7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_39ddf5e12daf56bbdd852012e02c933a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_0cbf8e92d07348569117686d7c37f05e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_3f6a7f4900a4bfc0329e7b2794a04706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_879605a97fc720a20cf881ea5f0b2ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_203dcb408840428a66f70020e3890c05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e62133cb-2894-5c7d-81ee-03219441c57d/e62133cb-2894-5c7d-81ee-03219441c57d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/14/8714c1dc99fe2adbeaa73354475df346/pa/BP63319_71b48d7fa8d9c631f2193e45cf328539.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 307 1.6 SW',
 'transmission': 'manual',
 'trim': 'SW',
 'year': 2005}
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP63319%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Saving data for BP63319: {'created_time': 1774871272.243784, 'last_price_update_time': 1774871272.243794, 'auction_closing_time': 1774971375.0}
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP63319') HTTP/1.1" 204 0
2026-03-30 11:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5076507f8823d360612bf196c2120837.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_9586bff93c60dd6068e3881bf5bbea83.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_9586bff93c60dd6068e3881bf5bbea83.jpg not downloaded yet
2026-03-30 11:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP81056> (referer: https://www.auto1.com/v1/car-details-view/LP81056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_5715fcc14e88c2993c0b9ded4092e041.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5715fcc14e88c2993c0b9ded4092e041.jpg not downloaded yet
2026-03-30 11:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb12310>
2026-03-30 11:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_5076507f8823d360612bf196c2120837.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5076507f8823d360612bf196c2120837.jpg saved to cache
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7711342194de11bb0b22e2d07a392fd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6948bea-1cfa-5328-9903-fbe528ffedc6 with identifier: LP81056
2026-03-30 11:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6948bea-1cfa-5328-9903-fbe528ffedc6 with scrape type 1
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b6948bea-1cfa-5328-9903-fbe528ffedc6
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F14%252Fd814e46be5da2cc6911375c90e53c771%252Fpa%252FLP81056_cedf1c2bf3a205aa7a0ab99dd26777f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_cedf1c2bf3a205aa7a0ab99dd26777f8.jpg already downloaded
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F14%252Fd814e46be5da2cc6911375c90e53c771%252Fpa%252FLP81056_bfab8af16042a2e3859631ed1e491094.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_bfab8af16042a2e3859631ed1e491094.jpg already downloaded
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F14%252Fd814e46be5da2cc6911375c90e53c771%252Fpa%252FLP81056_c91f8bf17d0bfa691b1092e5c93e2d01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_c91f8bf17d0bfa691b1092e5c93e2d01.jpg already downloaded
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F14%252Fd814e46be5da2cc6911375c90e53c771%252Fpa%252FLP81056_7d19dc431d3269019d6fe75c4e9e9d28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_7d19dc431d3269019d6fe75c4e9e9d28.jpg already downloaded
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F14%252Fd814e46be5da2cc6911375c90e53c771%252Fpa%252FLP81056_16f4a526d5c2663d250cf3c01ab81073.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_16f4a526d5c2663d250cf3c01ab81073.jpg already downloaded
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F14%252Fd814e46be5da2cc6911375c90e53c771%252Fpa%252FLP81056_85303a61a351253b42943d53965e3011.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_85303a61a351253b42943d53965e3011.jpg already downloaded
2026-03-30 11:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6948bea-1cfa-5328-9903-fbe528ffedc6, identifier: LP81056
2026-03-30 11:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6948bea-1cfa-5328-9903-fbe528ffedc6 with identifier: LP81056
2026-03-30 11:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6948bea-1cfa-5328-9903-fbe528ffedc6 with identifier: LP81056
2026-03-30 11:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6948bea-1cfa-5328-9903-fbe528ffedc6 with identifier: LP81056 to the API
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP81056>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:11:32Z',
 'fuel_type': 'diesel',
 'id': 'b6948bea-1cfa-5328-9903-fbe528ffedc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP81056',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 228729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_cedf1c2bf3a205aa7a0ab99dd26777f8.jpg',
                'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_bfab8af16042a2e3859631ed1e491094.jpg',
                'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_c91f8bf17d0bfa691b1092e5c93e2d01.jpg',
                'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_7d19dc431d3269019d6fe75c4e9e9d28.jpg',
                'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_16f4a526d5c2663d250cf3c01ab81073.jpg',
                'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_85303a61a351253b42943d53965e3011.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6948bea-1cfa-5328-9903-fbe528ffedc6/b6948bea-1cfa-5328-9903-fbe528ffedc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_cedf1c2bf3a205aa7a0ab99dd26777f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6948bea-1cfa-5328-9903-fbe528ffedc6/b6948bea-1cfa-5328-9903-fbe528ffedc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_bfab8af16042a2e3859631ed1e491094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6948bea-1cfa-5328-9903-fbe528ffedc6/b6948bea-1cfa-5328-9903-fbe528ffedc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_c91f8bf17d0bfa691b1092e5c93e2d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6948bea-1cfa-5328-9903-fbe528ffedc6/b6948bea-1cfa-5328-9903-fbe528ffedc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_7d19dc431d3269019d6fe75c4e9e9d28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6948bea-1cfa-5328-9903-fbe528ffedc6/b6948bea-1cfa-5328-9903-fbe528ffedc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_16f4a526d5c2663d250cf3c01ab81073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6948bea-1cfa-5328-9903-fbe528ffedc6/b6948bea-1cfa-5328-9903-fbe528ffedc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/14/d814e46be5da2cc6911375c90e53c771/pa/LP81056_85303a61a351253b42943d53965e3011.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP81056%27 HTTP/1.1" 200 None
2026-03-30 11:47:53 [auto1.be] INFO: Saving data for LP81056: {'created_time': 1774871273.079767, 'last_price_update_time': 1774871273.079779, 'auction_closing_time': 1774969892.0}
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP81056') HTTP/1.1" 204 0
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7bca3fec937160f6b938ecac6514c698.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5715fcc14e88c2993c0b9ded4092e041.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc928b90>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_7711342194de11bb0b22e2d07a392fd0.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7711342194de11bb0b22e2d07a392fd0.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78ca90>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_7bca3fec937160f6b938ecac6514c698.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7bca3fec937160f6b938ecac6514c698.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de861110>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_5715fcc14e88c2993c0b9ded4092e041.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5715fcc14e88c2993c0b9ded4092e041.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_9586bff93c60dd6068e3881bf5bbea83.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_a35d4d5774758c5cdda93a55480ea7d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6e8e10>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_9586bff93c60dd6068e3881bf5bbea83.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_9586bff93c60dd6068e3881bf5bbea83.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5e0850>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_a35d4d5774758c5cdda93a55480ea7d3.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_a35d4d5774758c5cdda93a55480ea7d3.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_de1463814117eb381e9cb6c1c6f7a312.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_6dece68e83f1bcbac6cf7f066b7b5966.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8320d0>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_de1463814117eb381e9cb6c1c6f7a312.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_de1463814117eb381e9cb6c1c6f7a312.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5e3910>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_6dece68e83f1bcbac6cf7f066b7b5966.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_6dece68e83f1bcbac6cf7f066b7b5966.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_983b11b49cc66afd0e9e12152bfe4e9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7884137187e42a4cf24fd0aa015fe10a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc99b6d0>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_983b11b49cc66afd0e9e12152bfe4e9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_983b11b49cc66afd0e9e12152bfe4e9e.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ba810>
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F64%252F7364112e1565d03b984e591a822782d5%252Fpa%252FAS78101_7884137187e42a4cf24fd0aa015fe10a.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7884137187e42a4cf24fd0aa015fe10a.jpg saved to cache
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0
2026-03-30 11:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fac1b7b-ce5d-5cfb-acde-54517f38fac0, skipping ID generation
2026-03-30 11:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0 with scrape type 1
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fac1b7b-ce5d-5cfb-acde-54517f38fac0 sending to next pipeline
2026-03-30 11:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fac1b7b-ce5d-5cfb-acde-54517f38fac0, identifier: AS78101
2026-03-30 11:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fac1b7b-ce5d-5cfb-acde-54517f38fac0 with identifier: AS78101
2026-03-30 11:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fac1b7b-ce5d-5cfb-acde-54517f38fac0 with identifier: AS78101
2026-03-30 11:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fac1b7b-ce5d-5cfb-acde-54517f38fac0 with identifier: AS78101 to the API
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7884137187e42a4cf24fd0aa015fe10a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:22:13Z',
 'fuel_type': 'petrol',
 'id': '7fac1b7b-ce5d-5cfb-acde-54517f38fac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS78101',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Alfa Romeo',
 'model': 'Alfa 147',
 'odometer': 118393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_983b11b49cc66afd0e9e12152bfe4e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5076507f8823d360612bf196c2120837.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7884137187e42a4cf24fd0aa015fe10a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_6dece68e83f1bcbac6cf7f066b7b5966.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_de1463814117eb381e9cb6c1c6f7a312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_a35d4d5774758c5cdda93a55480ea7d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7711342194de11bb0b22e2d07a392fd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_7bca3fec937160f6b938ecac6514c698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_9586bff93c60dd6068e3881bf5bbea83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fac1b7b-ce5d-5cfb-acde-54517f38fac0/7fac1b7b-ce5d-5cfb-acde-54517f38fac0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/64/7364112e1565d03b984e591a822782d5/pa/AS78101_5715fcc14e88c2993c0b9ded4092e041.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 147 1.6 TS ECO Impression',
 'transmission': 'manual',
 'trim': 'TS ECO Impression',
 'year': 2007}
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS78101%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Saving data for AS78101: {'created_time': 1774871274.445767, 'last_price_update_time': 1774871274.445778, 'auction_closing_time': 1774970533.0}
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AS78101') HTTP/1.1" 204 0
2026-03-30 11:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e3b457d1ba13bf061953350b38a944d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_c48a396358645c1ef731eacef2293a76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV32851> (referer: https://www.auto1.com/v1/car-details-view/CV32851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_55c564e8422222940a2e9b80f326c583.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc882d90>
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_e3b457d1ba13bf061953350b38a944d5.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e3b457d1ba13bf061953350b38a944d5.jpg saved to cache
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc92bd10>
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_c48a396358645c1ef731eacef2293a76.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_c48a396358645c1ef731eacef2293a76.jpg saved to cache
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb74cec-8a2a-57c2-b0d4-90399314c00d with identifier: CV32851
2026-03-30 11:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb74cec-8a2a-57c2-b0d4-90399314c00d with scrape type 1
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eeb74cec-8a2a-57c2-b0d4-90399314c00d
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_f35cb269404ee839747af9a6ffea84ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_f35cb269404ee839747af9a6ffea84ae.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_a3297f07fbca425a39ffa4ca3ebc86c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_a3297f07fbca425a39ffa4ca3ebc86c4.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_f8d5cf64eba9b0bad64b7a74dd44d84a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_f8d5cf64eba9b0bad64b7a74dd44d84a.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_0b277309f29900249f24d7f5eda0eefb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_0b277309f29900249f24d7f5eda0eefb.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_90b3000b91ed2e636e34952a361cec31.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_90b3000b91ed2e636e34952a361cec31.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_e8e2ab17dbf87b3823c14a66d7d788dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_e8e2ab17dbf87b3823c14a66d7d788dd.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_1ee726a71a8db48a88129c45c2a545fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_1ee726a71a8db48a88129c45c2a545fc.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_320a0366de8f89c9d98303dda98bd473.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_320a0366de8f89c9d98303dda98bd473.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_c314595e425851062ba344890c1444c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_c314595e425851062ba344890c1444c1.jpg already downloaded
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252F6f%252F6f6f0d64112756cf1d62f918ca5e9008%252Fpa%252FCV32851_64be90ee6f4d8d8fee42195337d97927.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_64be90ee6f4d8d8fee42195337d97927.jpg already downloaded
2026-03-30 11:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eeb74cec-8a2a-57c2-b0d4-90399314c00d, identifier: CV32851
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8f5d90>
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F0f%252F8e0ff986cd1d218b5b3778d7fe02fa17%252Fpa%252FXD22727_55c564e8422222940a2e9b80f326c583.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_55c564e8422222940a2e9b80f326c583.jpg saved to cache
2026-03-30 11:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29c498df-6f07-55a1-98f0-21e8d551212c
2026-03-30 11:47:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29c498df-6f07-55a1-98f0-21e8d551212c, skipping ID generation
2026-03-30 11:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c498df-6f07-55a1-98f0-21e8d551212c with scrape type 1
2026-03-30 11:47:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29c498df-6f07-55a1-98f0-21e8d551212c sending to next pipeline
2026-03-30 11:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29c498df-6f07-55a1-98f0-21e8d551212c, identifier: XD22727
2026-03-30 11:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eeb74cec-8a2a-57c2-b0d4-90399314c00d with identifier: CV32851
2026-03-30 11:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eeb74cec-8a2a-57c2-b0d4-90399314c00d with identifier: CV32851
2026-03-30 11:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eeb74cec-8a2a-57c2-b0d4-90399314c00d with identifier: CV32851 to the API
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CV32851>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:49:16Z',
 'fuel_type': 'diesel',
 'id': 'eeb74cec-8a2a-57c2-b0d4-90399314c00d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV32851',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 134203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_f35cb269404ee839747af9a6ffea84ae.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_a3297f07fbca425a39ffa4ca3ebc86c4.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_f8d5cf64eba9b0bad64b7a74dd44d84a.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_0b277309f29900249f24d7f5eda0eefb.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_90b3000b91ed2e636e34952a361cec31.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_e8e2ab17dbf87b3823c14a66d7d788dd.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_1ee726a71a8db48a88129c45c2a545fc.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_320a0366de8f89c9d98303dda98bd473.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_c314595e425851062ba344890c1444c1.jpg',
                'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_64be90ee6f4d8d8fee42195337d97927.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3939312,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_f35cb269404ee839747af9a6ffea84ae.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_a3297f07fbca425a39ffa4ca3ebc86c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_f8d5cf64eba9b0bad64b7a74dd44d84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_0b277309f29900249f24d7f5eda0eefb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_90b3000b91ed2e636e34952a361cec31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_e8e2ab17dbf87b3823c14a66d7d788dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_1ee726a71a8db48a88129c45c2a545fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_320a0366de8f89c9d98303dda98bd473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_c314595e425851062ba344890c1444c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb74cec-8a2a-57c2-b0d4-90399314c00d/eeb74cec-8a2a-57c2-b0d4-90399314c00d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/6f/6f6f0d64112756cf1d62f918ca5e9008/pa/CV32851_64be90ee6f4d8d8fee42195337d97927.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV32851%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Saving data for CV32851: {'created_time': 1774871275.400981, 'last_price_update_time': 1774871275.400993, 'auction_closing_time': 1774972156.0}
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CV32851') HTTP/1.1" 204 0
2026-03-30 11:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29c498df-6f07-55a1-98f0-21e8d551212c with identifier: XD22727
2026-03-30 11:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29c498df-6f07-55a1-98f0-21e8d551212c with identifier: XD22727
2026-03-30 11:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29c498df-6f07-55a1-98f0-21e8d551212c with identifier: XD22727 to the API
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_55c564e8422222940a2e9b80f326c583.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:38:51Z',
 'fuel_type': 'diesel',
 'id': '29c498df-6f07-55a1-98f0-21e8d551212c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD22727',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 254630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_55c564e8422222940a2e9b80f326c583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_40a7a3cf03ba8ed7c8d95198e91ca8c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_c48a396358645c1ef731eacef2293a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e3b457d1ba13bf061953350b38a944d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_3937aa3e3f899ceff27451f229e5233f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_d402b3ba2604a445f6ecbb5920b617c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_e2b3baf067830d7bfdc8d30e29bda723.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_261ab7df2b8786a536a62989bce0aca4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_65cd98c69d44f9112a1065be593d1196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c498df-6f07-55a1-98f0-21e8d551212c/29c498df-6f07-55a1-98f0-21e8d551212c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/0f/8e0ff986cd1d218b5b3778d7fe02fa17/pa/XD22727_41da4fcc5cd63ea4debd91d1553b1ec2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2008}
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD22727%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Saving data for XD22727: {'created_time': 1774871275.75662, 'last_price_update_time': 1774871275.756633, 'auction_closing_time': 1774971531.0}
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD22727') HTTP/1.1" 204 0
2026-03-30 11:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW28464> (referer: https://www.auto1.com/v1/car-details-view/FW28464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_0a9c3644f16155f5644eeabe25c1a8e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5023ec19-0787-5d10-b0aa-c6d9ebe195e4 with identifier: FW28464
2026-03-30 11:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4 with scrape type 1
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_0785a5726a2a0fadc378f6db5051bd12.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_0785a5726a2a0fadc378f6db5051bd12.png not downloaded yet
2026-03-30 11:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_15e5d75f825a5a2e6475c2cda6927cfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_c5d94eb5a0a0ae1ae459e7995936a75e.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_c5d94eb5a0a0ae1ae459e7995936a75e.png not downloaded yet
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_5145d504b3e5b7ac858e75a307f48d3b.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_5145d504b3e5b7ac858e75a307f48d3b.png not downloaded yet
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_86eda4e964d8639c09dc6a9dc6cc352e.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_86eda4e964d8639c09dc6a9dc6cc352e.png not downloaded yet
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_710c3e0ebb44adbfa29740cb1c3ea84d.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_710c3e0ebb44adbfa29740cb1c3ea84d.png not downloaded yet
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83c390>
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_0a9c3644f16155f5644eeabe25c1a8e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_0a9c3644f16155f5644eeabe25c1a8e5.jpg saved to cache
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_56a7895a5e066bde366a431467479ac7.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_56a7895a5e066bde366a431467479ac7.png not downloaded yet
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_243a34d9a765297036a59e093975d89c.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_243a34d9a765297036a59e093975d89c.png not downloaded yet
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_bde29d7265f460c124270ef86f7152f9.png%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_bde29d7265f460c124270ef86f7152f9.png not downloaded yet
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc893bd0>
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_15e5d75f825a5a2e6475c2cda6927cfb.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_15e5d75f825a5a2e6475c2cda6927cfb.jpg saved to cache
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_caa854c4be4b505572db2be7f30f8779.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_caa854c4be4b505572db2be7f30f8779.jpg not downloaded yet
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_3bbabc3800826a81cf16819671c8870b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_3bbabc3800826a81cf16819671c8870b.jpg not downloaded yet
2026-03-30 11:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_0785a5726a2a0fadc378f6db5051bd12.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_3bbabc3800826a81cf16819671c8870b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:58 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d690>
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_0.png HTTP/1.1" 201 0
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_0785a5726a2a0fadc378f6db5051bd12.png') HTTP/1.1" 204 0
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_0785a5726a2a0fadc378f6db5051bd12.png saved to cache
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_caa854c4be4b505572db2be7f30f8779.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d9690>
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_3bbabc3800826a81cf16819671c8870b.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_3bbabc3800826a81cf16819671c8870b.jpg saved to cache
2026-03-30 11:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6e8b50>
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_caa854c4be4b505572db2be7f30f8779.jpg') HTTP/1.1" 204 0
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_caa854c4be4b505572db2be7f30f8779.jpg saved to cache
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_bde29d7265f460c124270ef86f7152f9.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca84390>
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_7.png HTTP/1.1" 201 0
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_bde29d7265f460c124270ef86f7152f9.png') HTTP/1.1" 204 0
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_bde29d7265f460c124270ef86f7152f9.png saved to cache
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_243a34d9a765297036a59e093975d89c.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d9890>
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_6.png HTTP/1.1" 201 0
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_243a34d9a765297036a59e093975d89c.png') HTTP/1.1" 204 0
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_243a34d9a765297036a59e093975d89c.png saved to cache
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_56a7895a5e066bde366a431467479ac7.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc794710>
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_5.png HTTP/1.1" 201 0
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_56a7895a5e066bde366a431467479ac7.png') HTTP/1.1" 204 0
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_56a7895a5e066bde366a431467479ac7.png saved to cache
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_710c3e0ebb44adbfa29740cb1c3ea84d.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc991390>
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_4.png HTTP/1.1" 201 0
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_710c3e0ebb44adbfa29740cb1c3ea84d.png') HTTP/1.1" 204 0
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_710c3e0ebb44adbfa29740cb1c3ea84d.png saved to cache
2026-03-30 11:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_86eda4e964d8639c09dc6a9dc6cc352e.png> (referer: https://www.auto1.com/)
2026-03-30 11:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD12603> (referer: https://www.auto1.com/v1/car-details-view/PD12603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:47:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc769450>
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_3.png HTTP/1.1" 201 0
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_86eda4e964d8639c09dc6a9dc6cc352e.png') HTTP/1.1" 204 0
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_86eda4e964d8639c09dc6a9dc6cc352e.png saved to cache
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4cb3d2-48fa-5b10-b385-94504a3ea657 with identifier: PD12603
2026-03-30 11:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4cb3d2-48fa-5b10-b385-94504a3ea657 with scrape type 1
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_4145ff6a8e40a63a848eea13f7c29478.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_4145ff6a8e40a63a848eea13f7c29478.jpg not downloaded yet
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_b5d4c5784d1edaa0d7d31d01d2a9526f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_b5d4c5784d1edaa0d7d31d01d2a9526f.jpg not downloaded yet
2026-03-30 11:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_5145d504b3e5b7ac858e75a307f48d3b.png> (referer: https://www.auto1.com/)
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_bf194c9bda53869c007c6446edac6d93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_bf194c9bda53869c007c6446edac6d93.jpg not downloaded yet
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_11ece1bf0f76c6c75d5d7b48b0962a13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_11ece1bf0f76c6c75d5d7b48b0962a13.jpg not downloaded yet
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_1ed23eefc3fb063401fadfff72b78ba8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_1ed23eefc3fb063401fadfff72b78ba8.jpg not downloaded yet
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_c9b52ed233dc920d9b92cc58f8ba3642.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_c9b52ed233dc920d9b92cc58f8ba3642.jpg not downloaded yet
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_5cd14c8028b8f5ca368e839cd97a1ac2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_5cd14c8028b8f5ca368e839cd97a1ac2.jpg not downloaded yet
2026-03-30 11:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_4145ff6a8e40a63a848eea13f7c29478.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_d03dde3dda06e9c1a13b8e1ab2797a03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_d03dde3dda06e9c1a13b8e1ab2797a03.jpg not downloaded yet
2026-03-30 11:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_c5d94eb5a0a0ae1ae459e7995936a75e.png> (referer: https://www.auto1.com/)
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_59a117b7200cc41c478cb0013afa9fd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_59a117b7200cc41c478cb0013afa9fd2.jpg not downloaded yet
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_f6a0fb3ec00e791f65ba68ba9bb17c7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_f6a0fb3ec00e791f65ba68ba9bb17c7c.jpg not downloaded yet
2026-03-30 11:48:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:48:00 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:48:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5e2a50>
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_2.png HTTP/1.1" 201 0
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_5145d504b3e5b7ac858e75a307f48d3b.png') HTTP/1.1" 204 0
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_5145d504b3e5b7ac858e75a307f48d3b.png saved to cache
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc819710>
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_4145ff6a8e40a63a848eea13f7c29478.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_4145ff6a8e40a63a848eea13f7c29478.jpg saved to cache
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:48:00 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:48:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca50d10>
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_1.png HTTP/1.1" 201 0
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F26%252Ff62695883472948b60bedfcf074f3d52%252Fpa%252FFW28464_c5d94eb5a0a0ae1ae459e7995936a75e.png') HTTP/1.1" 204 0
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_c5d94eb5a0a0ae1ae459e7995936a75e.png saved to cache
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4
2026-03-30 11:48:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5023ec19-0787-5d10-b0aa-c6d9ebe195e4, skipping ID generation
2026-03-30 11:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4 with scrape type 1
2026-03-30 11:48:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5023ec19-0787-5d10-b0aa-c6d9ebe195e4 sending to next pipeline
2026-03-30 11:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5023ec19-0787-5d10-b0aa-c6d9ebe195e4, identifier: FW28464
2026-03-30 11:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5023ec19-0787-5d10-b0aa-c6d9ebe195e4 with identifier: FW28464
2026-03-30 11:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5023ec19-0787-5d10-b0aa-c6d9ebe195e4 with identifier: FW28464
2026-03-30 11:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5023ec19-0787-5d10-b0aa-c6d9ebe195e4 with identifier: FW28464 to the API
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_c5d94eb5a0a0ae1ae459e7995936a75e.png>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:47:58Z',
 'fuel_type': 'petrol',
 'id': '5023ec19-0787-5d10-b0aa-c6d9ebe195e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW28464',
 'listing': 'auction',
 'location': 'BE, Tongeren',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 76373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 1022406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_0785a5726a2a0fadc378f6db5051bd12.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 1022406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_c5d94eb5a0a0ae1ae459e7995936a75e.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 986258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_5145d504b3e5b7ac858e75a307f48d3b.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 986258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_86eda4e964d8639c09dc6a9dc6cc352e.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 974375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_710c3e0ebb44adbfa29740cb1c3ea84d.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 962383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_56a7895a5e066bde366a431467479ac7.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 962383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_243a34d9a765297036a59e093975d89c.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 962383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_bde29d7265f460c124270ef86f7152f9.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_caa854c4be4b505572db2be7f30f8779.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5023ec19-0787-5d10-b0aa-c6d9ebe195e4/5023ec19-0787-5d10-b0aa-c6d9ebe195e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/26/f62695883472948b60bedfcf074f3d52/pa/FW28464_3bbabc3800826a81cf16819671c8870b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2023}
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW28464%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [auto1.be] INFO: Saving data for FW28464: {'created_time': 1774871281.061626, 'last_price_update_time': 1774871281.061639, 'auction_closing_time': 1774972078.0}
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW28464') HTTP/1.1" 204 0
2026-03-30 11:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_5cd14c8028b8f5ca368e839cd97a1ac2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_c9b52ed233dc920d9b92cc58f8ba3642.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP32209> (referer: https://www.auto1.com/v1/car-details-view/UP32209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73de803710>
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_5cd14c8028b8f5ca368e839cd97a1ac2.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_5cd14c8028b8f5ca368e839cd97a1ac2.jpg saved to cache
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca6f950>
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_c9b52ed233dc920d9b92cc58f8ba3642.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_c9b52ed233dc920d9b92cc58f8ba3642.jpg saved to cache
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d639f1-10dc-5af4-a601-9e93635ddb7a with identifier: UP32209
2026-03-30 11:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d639f1-10dc-5af4-a601-9e93635ddb7a with scrape type 1
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2d639f1-10dc-5af4-a601-9e93635ddb7a
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_9e0a3f83bdc807d0546c5c0907e43fe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_9e0a3f83bdc807d0546c5c0907e43fe4.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_ae9f9f4026e270b05947136f93653fd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_ae9f9f4026e270b05947136f93653fd2.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_2300505fdec6a21d9d4bb75ad4811061.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_2300505fdec6a21d9d4bb75ad4811061.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_4723855bcab5c9f2479be15753742903.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_4723855bcab5c9f2479be15753742903.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_7b01bc2ed95ec3df899ae6045022142e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_7b01bc2ed95ec3df899ae6045022142e.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_9540e8280b7808560502d58dc2d41c4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_9540e8280b7808560502d58dc2d41c4e.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_ed4878dd4ba8197ccba94bbc1d20bc03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_ed4878dd4ba8197ccba94bbc1d20bc03.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_611404e948ea6d2dbe56b60c13e690aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_611404e948ea6d2dbe56b60c13e690aa.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_32c342ae12ca3da700d12e222bf7455a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_32c342ae12ca3da700d12e222bf7455a.jpg already downloaded
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fc7%252F56c7bf23483c91d0831b873cde51f81a%252Fpa%252FUP32209_d8006596dec77c6f6224dda912a0f4d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_d8006596dec77c6f6224dda912a0f4d1.jpg already downloaded
2026-03-30 11:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2d639f1-10dc-5af4-a601-9e93635ddb7a, identifier: UP32209
2026-03-30 11:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2d639f1-10dc-5af4-a601-9e93635ddb7a with identifier: UP32209
2026-03-30 11:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2d639f1-10dc-5af4-a601-9e93635ddb7a with identifier: UP32209
2026-03-30 11:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2d639f1-10dc-5af4-a601-9e93635ddb7a with identifier: UP32209 to the API
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UP32209>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:59:11Z',
 'fuel_type': 'petrol',
 'id': 'c2d639f1-10dc-5af4-a601-9e93635ddb7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP32209',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 129703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_9e0a3f83bdc807d0546c5c0907e43fe4.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_ae9f9f4026e270b05947136f93653fd2.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_2300505fdec6a21d9d4bb75ad4811061.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_4723855bcab5c9f2479be15753742903.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_7b01bc2ed95ec3df899ae6045022142e.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_9540e8280b7808560502d58dc2d41c4e.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_ed4878dd4ba8197ccba94bbc1d20bc03.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_611404e948ea6d2dbe56b60c13e690aa.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_32c342ae12ca3da700d12e222bf7455a.jpg',
                'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_d8006596dec77c6f6224dda912a0f4d1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2474054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_9e0a3f83bdc807d0546c5c0907e43fe4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_ae9f9f4026e270b05947136f93653fd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_2300505fdec6a21d9d4bb75ad4811061.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_4723855bcab5c9f2479be15753742903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_7b01bc2ed95ec3df899ae6045022142e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_9540e8280b7808560502d58dc2d41c4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1902619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_ed4878dd4ba8197ccba94bbc1d20bc03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_611404e948ea6d2dbe56b60c13e690aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_32c342ae12ca3da700d12e222bf7455a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d639f1-10dc-5af4-a601-9e93635ddb7a/c2d639f1-10dc-5af4-a601-9e93635ddb7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2919676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/c7/56c7bf23483c91d0831b873cde51f81a/pa/UP32209_d8006596dec77c6f6224dda912a0f4d1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UP32209%27 HTTP/1.1" 200 None
2026-03-30 11:48:01 [auto1.be] INFO: Saving data for UP32209: {'created_time': 1774871281.985056, 'last_price_update_time': 1774871281.985069, 'auction_closing_time': 1774972751.0}
2026-03-30 11:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UP32209') HTTP/1.1" 204 0
2026-03-30 11:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_f6a0fb3ec00e791f65ba68ba9bb17c7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_59a117b7200cc41c478cb0013afa9fd2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_d03dde3dda06e9c1a13b8e1ab2797a03.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81b290>
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_f6a0fb3ec00e791f65ba68ba9bb17c7c.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_f6a0fb3ec00e791f65ba68ba9bb17c7c.jpg saved to cache
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7aee50>
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_59a117b7200cc41c478cb0013afa9fd2.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_59a117b7200cc41c478cb0013afa9fd2.jpg saved to cache
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca1bb90>
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_d03dde3dda06e9c1a13b8e1ab2797a03.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_d03dde3dda06e9c1a13b8e1ab2797a03.jpg saved to cache
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_1ed23eefc3fb063401fadfff72b78ba8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_11ece1bf0f76c6c75d5d7b48b0962a13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a20716c2c2c10e84625c524b8591b1e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81d110>
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_1ed23eefc3fb063401fadfff72b78ba8.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_1ed23eefc3fb063401fadfff72b78ba8.jpg saved to cache
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d8d0>
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_11ece1bf0f76c6c75d5d7b48b0962a13.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_11ece1bf0f76c6c75d5d7b48b0962a13.jpg saved to cache
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_b5d4c5784d1edaa0d7d31d01d2a9526f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73defbaed0>
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fba%252Fb6bab5e24db0efcd74765d340e76a109%252Fpa%252FXK60996_a20716c2c2c10e84625c524b8591b1e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a20716c2c2c10e84625c524b8591b1e9.jpg saved to cache
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79c17303-0131-5035-a58c-565bcbe82603
2026-03-30 11:48:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79c17303-0131-5035-a58c-565bcbe82603, skipping ID generation
2026-03-30 11:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79c17303-0131-5035-a58c-565bcbe82603 with scrape type 1
2026-03-30 11:48:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79c17303-0131-5035-a58c-565bcbe82603 sending to next pipeline
2026-03-30 11:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79c17303-0131-5035-a58c-565bcbe82603, identifier: XK60996
2026-03-30 11:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79c17303-0131-5035-a58c-565bcbe82603 with identifier: XK60996
2026-03-30 11:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79c17303-0131-5035-a58c-565bcbe82603 with identifier: XK60996
2026-03-30 11:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79c17303-0131-5035-a58c-565bcbe82603 with identifier: XK60996 to the API
2026-03-30 11:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a20716c2c2c10e84625c524b8591b1e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:14:08Z',
 'fuel_type': 'petrol',
 'id': '79c17303-0131-5035-a58c-565bcbe82603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK60996',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 177342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_6a633ea22e5a607de356e1d49420b32e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_2c817ce60f65497c463dc1526252ca02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a20716c2c2c10e84625c524b8591b1e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_f57792ba1940248de17752bd92ce2e90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_15e5d75f825a5a2e6475c2cda6927cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_1a4adac3c42b92da761f32cf4573b9f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_a0aa910ebaf5f97bcb04fa8164bcdbd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_0a9c3644f16155f5644eeabe25c1a8e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_28d2d2c6b772fb14bf042331c1c86f46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c17303-0131-5035-a58c-565bcbe82603/79c17303-0131-5035-a58c-565bcbe82603_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ba/b6bab5e24db0efcd74765d340e76a109/pa/XK60996_d76f6f795f4c83809fcec86fdebc914e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK60996%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [auto1.be] INFO: Saving data for XK60996: {'created_time': 1774871283.151551, 'last_price_update_time': 1774871283.151562, 'auction_closing_time': 1774970048.0}
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK60996') HTTP/1.1" 204 0
2026-03-30 11:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT25789> (referer: https://www.auto1.com/v1/car-details-view/KT25789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca54f90>
2026-03-30 11:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_b5d4c5784d1edaa0d7d31d01d2a9526f.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_b5d4c5784d1edaa0d7d31d01d2a9526f.jpg saved to cache
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_bf194c9bda53869c007c6446edac6d93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285f6e3a-2e12-52cc-980f-89f2bc3b3a66 with identifier: KT25789
2026-03-30 11:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285f6e3a-2e12-52cc-980f-89f2bc3b3a66 with scrape type 1
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 285f6e3a-2e12-52cc-980f-89f2bc3b3a66
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_a2babf349eb501d48e4d004e58964de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_a2babf349eb501d48e4d004e58964de1.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_4d41cff118c97c5df178efe973760196.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_4d41cff118c97c5df178efe973760196.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_1ee8e36de41c68a010c8913283883725.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_1ee8e36de41c68a010c8913283883725.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_7ae0d57f47e882fa225eea08a76f851f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_7ae0d57f47e882fa225eea08a76f851f.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_87a18d33a4d4bc241d7bb461dc9a7efc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_87a18d33a4d4bc241d7bb461dc9a7efc.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_8480a22d065cbc4a829b2c60eee0e714.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_8480a22d065cbc4a829b2c60eee0e714.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_6df189b8386c04252d7aa7bc5653510b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_6df189b8386c04252d7aa7bc5653510b.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_3513336deafe12fe66b724305e67c410.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_3513336deafe12fe66b724305e67c410.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_7a08182a5912fab554923648ead63e1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_7a08182a5912fab554923648ead63e1d.jpg already downloaded
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff0%252F82f0d69361ec15b0634d3b2345555a60%252Fpa%252FKT25789_8d6badffce1d730b08768c9904295846.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_8d6badffce1d730b08768c9904295846.jpg already downloaded
2026-03-30 11:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 285f6e3a-2e12-52cc-980f-89f2bc3b3a66, identifier: KT25789
2026-03-30 11:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 285f6e3a-2e12-52cc-980f-89f2bc3b3a66 with identifier: KT25789
2026-03-30 11:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 285f6e3a-2e12-52cc-980f-89f2bc3b3a66 with identifier: KT25789
2026-03-30 11:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 285f6e3a-2e12-52cc-980f-89f2bc3b3a66 with identifier: KT25789 to the API
2026-03-30 11:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KT25789>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:20:37Z',
 'fuel_type': 'diesel',
 'id': '285f6e3a-2e12-52cc-980f-89f2bc3b3a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT25789',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 207113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_a2babf349eb501d48e4d004e58964de1.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_4d41cff118c97c5df178efe973760196.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_1ee8e36de41c68a010c8913283883725.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_7ae0d57f47e882fa225eea08a76f851f.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_87a18d33a4d4bc241d7bb461dc9a7efc.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_8480a22d065cbc4a829b2c60eee0e714.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_6df189b8386c04252d7aa7bc5653510b.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_3513336deafe12fe66b724305e67c410.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_7a08182a5912fab554923648ead63e1d.jpg',
                'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_8d6badffce1d730b08768c9904295846.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_a2babf349eb501d48e4d004e58964de1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_4d41cff118c97c5df178efe973760196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_1ee8e36de41c68a010c8913283883725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2360062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_7ae0d57f47e882fa225eea08a76f851f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_87a18d33a4d4bc241d7bb461dc9a7efc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_8480a22d065cbc4a829b2c60eee0e714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_6df189b8386c04252d7aa7bc5653510b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_3513336deafe12fe66b724305e67c410.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_7a08182a5912fab554923648ead63e1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285f6e3a-2e12-52cc-980f-89f2bc3b3a66/285f6e3a-2e12-52cc-980f-89f2bc3b3a66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f0/82f0d69361ec15b0634d3b2345555a60/pa/KT25789_8d6badffce1d730b08768c9904295846.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2017}
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT25789%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.be] INFO: Saving data for KT25789: {'created_time': 1774871284.133814, 'last_price_update_time': 1774871284.133823, 'auction_closing_time': 1774970437.0}
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT25789') HTTP/1.1" 204 0
2026-03-30 11:48:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dcab16d0>
2026-03-30 11:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F31%252F0b312b4569a10996e0f5b90cb898cc6b%252Fpa%252FPD12603_bf194c9bda53869c007c6446edac6d93.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_bf194c9bda53869c007c6446edac6d93.jpg saved to cache
2026-03-30 11:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa4cb3d2-48fa-5b10-b385-94504a3ea657
2026-03-30 11:48:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa4cb3d2-48fa-5b10-b385-94504a3ea657, skipping ID generation
2026-03-30 11:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4cb3d2-48fa-5b10-b385-94504a3ea657 with scrape type 1
2026-03-30 11:48:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa4cb3d2-48fa-5b10-b385-94504a3ea657 sending to next pipeline
2026-03-30 11:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aa4cb3d2-48fa-5b10-b385-94504a3ea657, identifier: PD12603
2026-03-30 11:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aa4cb3d2-48fa-5b10-b385-94504a3ea657 with identifier: PD12603
2026-03-30 11:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aa4cb3d2-48fa-5b10-b385-94504a3ea657 with identifier: PD12603
2026-03-30 11:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aa4cb3d2-48fa-5b10-b385-94504a3ea657 with identifier: PD12603 to the API
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_bf194c9bda53869c007c6446edac6d93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:13:18Z',
 'fuel_type': 'petrol',
 'id': 'aa4cb3d2-48fa-5b10-b385-94504a3ea657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD12603',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 65182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_4145ff6a8e40a63a848eea13f7c29478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_b5d4c5784d1edaa0d7d31d01d2a9526f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034513,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_bf194c9bda53869c007c6446edac6d93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_11ece1bf0f76c6c75d5d7b48b0962a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_1ed23eefc3fb063401fadfff72b78ba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_c9b52ed233dc920d9b92cc58f8ba3642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_5cd14c8028b8f5ca368e839cd97a1ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3057487,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_d03dde3dda06e9c1a13b8e1ab2797a03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2897562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_59a117b7200cc41c478cb0013afa9fd2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4cb3d2-48fa-5b10-b385-94504a3ea657/aa4cb3d2-48fa-5b10-b385-94504a3ea657_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/31/0b312b4569a10996e0f5b90cb898cc6b/pa/PD12603_f6a0fb3ec00e791f65ba68ba9bb17c7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD12603%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.be] INFO: Saving data for PD12603: {'created_time': 1774871284.960434, 'last_price_update_time': 1774871284.960442, 'auction_closing_time': 1774969998.0}
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD12603') HTTP/1.1" 204 0
2026-03-30 11:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD90216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:06 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1765 | hits on page: 40
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: VP95014
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP95014%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for VP95014: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for DZ24480: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for GN71373: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for MJ01257: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for AY48728: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: FH32822
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: LB99980
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: GS30663
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: YE48599
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YE48599%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for YE48599: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: XY44449
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: JT22008
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: KN48892
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN48892%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for KN48892: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: EM93050
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for PV35906: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: GC80115
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: GL14353
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL14353%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for GL14353: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: NH22682
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH22682%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for NH22682: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: WR44467
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: FH77078
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH77078%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for FH77078: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for BH52169: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for NN42676: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: RH39924
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: EP05559
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: ML39304
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML39304%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for ML39304: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: XV08295
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV08295%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for XV08295: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for TX99790: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for PL33803: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for NA97131: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for FV38279: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for TX28125: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for MH10936: 0
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: CY95631
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: UF38996
2026-03-30 11:48:06 [auto1.be] INFO: Found listing with ID: ED62480
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED62480%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.be] INFO: Scrape type for ED62480: 0
2026-03-30 11:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY15914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:06 [scrapy.extensions.logstats] INFO: Crawled 173 pages (at 40 pages/min), scraped 118 items (at 26 items/min)
2026-03-30 11:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP57760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL82262> (referer: https://www.auto1.com/v1/car-details-view/SL82262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2910395-45a4-5b0a-9d5d-7ed4f03936e2 with identifier: SL82262
2026-03-30 11:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2 with scrape type 1
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_99897d82b6ef945a83761e6dd747aa13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_99897d82b6ef945a83761e6dd747aa13.jpg not downloaded yet
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_79c23371aeed5c2399f640d6026a04dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_79c23371aeed5c2399f640d6026a04dd.jpg not downloaded yet
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ66091/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_7bd7b71bf5077e8c712187d230d95564.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_7bd7b71bf5077e8c712187d230d95564.jpg not downloaded yet
2026-03-30 11:48:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_961590bca29db03f6dd2bbbd305b6fec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_961590bca29db03f6dd2bbbd305b6fec.jpg not downloaded yet
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_c2af535a0cf255e611e0ee4ca9b2bc85.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_c2af535a0cf255e611e0ee4ca9b2bc85.jpg not downloaded yet
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_17b776d1b2cdfb6ad610cb460ae847f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_17b776d1b2cdfb6ad610cb460ae847f7.jpg not downloaded yet
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_70dd1837226c84618c1969d35e58028d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_70dd1837226c84618c1969d35e58028d.jpg not downloaded yet
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_99897d82b6ef945a83761e6dd747aa13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_b266c7bedc376efc7f2c1555b5d24294.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_b266c7bedc376efc7f2c1555b5d24294.jpg not downloaded yet
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_854a3df87cdd51c74c407709ac2cbe02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_854a3df87cdd51c74c407709ac2cbe02.jpg not downloaded yet
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_a3ad763bea23c2974f450032c5ca1b88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_a3ad763bea23c2974f450032c5ca1b88.jpg not downloaded yet
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_961590bca29db03f6dd2bbbd305b6fec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_79c23371aeed5c2399f640d6026a04dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb11b10>
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_99897d82b6ef945a83761e6dd747aa13.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_99897d82b6ef945a83761e6dd747aa13.jpg saved to cache
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_c2af535a0cf255e611e0ee4ca9b2bc85.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_17b776d1b2cdfb6ad610cb460ae847f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca6f4d0>
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_961590bca29db03f6dd2bbbd305b6fec.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_961590bca29db03f6dd2bbbd305b6fec.jpg saved to cache
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_70dd1837226c84618c1969d35e58028d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc882550>
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_79c23371aeed5c2399f640d6026a04dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_79c23371aeed5c2399f640d6026a04dd.jpg saved to cache
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc929650>
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_c2af535a0cf255e611e0ee4ca9b2bc85.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_c2af535a0cf255e611e0ee4ca9b2bc85.jpg saved to cache
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6ec5d0>
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_17b776d1b2cdfb6ad610cb460ae847f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_17b776d1b2cdfb6ad610cb460ae847f7.jpg saved to cache
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc838690>
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_70dd1837226c84618c1969d35e58028d.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_70dd1837226c84618c1969d35e58028d.jpg saved to cache
2026-03-30 11:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_b266c7bedc376efc7f2c1555b5d24294.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_854a3df87cdd51c74c407709ac2cbe02.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_7bd7b71bf5077e8c712187d230d95564.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_a3ad763bea23c2974f450032c5ca1b88.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc815fd0>
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_b266c7bedc376efc7f2c1555b5d24294.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_b266c7bedc376efc7f2c1555b5d24294.jpg saved to cache
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d2d0>
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_854a3df87cdd51c74c407709ac2cbe02.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_854a3df87cdd51c74c407709ac2cbe02.jpg saved to cache
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0f590>
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_7bd7b71bf5077e8c712187d230d95564.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_7bd7b71bf5077e8c712187d230d95564.jpg saved to cache
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc939510>
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F00%252Fc20033d0af49a494d7943eb845688f0b%252Fpa%252FSL82262_a3ad763bea23c2974f450032c5ca1b88.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_a3ad763bea23c2974f450032c5ca1b88.jpg saved to cache
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2
2026-03-30 11:48:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2910395-45a4-5b0a-9d5d-7ed4f03936e2, skipping ID generation
2026-03-30 11:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2 with scrape type 1
2026-03-30 11:48:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2910395-45a4-5b0a-9d5d-7ed4f03936e2 sending to next pipeline
2026-03-30 11:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2910395-45a4-5b0a-9d5d-7ed4f03936e2, identifier: SL82262
2026-03-30 11:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2910395-45a4-5b0a-9d5d-7ed4f03936e2 with identifier: SL82262
2026-03-30 11:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2910395-45a4-5b0a-9d5d-7ed4f03936e2 with identifier: SL82262
2026-03-30 11:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2910395-45a4-5b0a-9d5d-7ed4f03936e2 with identifier: SL82262 to the API
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_a3ad763bea23c2974f450032c5ca1b88.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:51:19Z',
 'fuel_type': 'diesel',
 'id': 'e2910395-45a4-5b0a-9d5d-7ed4f03936e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL82262',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 131182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_99897d82b6ef945a83761e6dd747aa13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881563,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_79c23371aeed5c2399f640d6026a04dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_7bd7b71bf5077e8c712187d230d95564.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_961590bca29db03f6dd2bbbd305b6fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_c2af535a0cf255e611e0ee4ca9b2bc85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_17b776d1b2cdfb6ad610cb460ae847f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_70dd1837226c84618c1969d35e58028d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_b266c7bedc376efc7f2c1555b5d24294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_854a3df87cdd51c74c407709ac2cbe02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2910395-45a4-5b0a-9d5d-7ed4f03936e2/e2910395-45a4-5b0a-9d5d-7ed4f03936e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2921317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/00/c20033d0af49a494d7943eb845688f0b/pa/SL82262_a3ad763bea23c2974f450032c5ca1b88.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-30 11:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL82262%27 HTTP/1.1" 200 None
2026-03-30 11:48:10 [auto1.be] INFO: Saving data for SL82262: {'created_time': 1774871290.027175, 'last_price_update_time': 1774871290.027186, 'auction_closing_time': 1774972279.0}
2026-03-30 11:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL82262') HTTP/1.1" 204 0
2026-03-30 11:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD90216> (referer: https://www.auto1.com/v1/car-details-view/MD90216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f653433c-18e0-54b4-853c-a0c4951018b7 with identifier: MD90216
2026-03-30 11:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f653433c-18e0-54b4-853c-a0c4951018b7 with scrape type 1
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f653433c-18e0-54b4-853c-a0c4951018b7
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_fdca12a8e7219be585c0cfe7b11cc6d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_fdca12a8e7219be585c0cfe7b11cc6d1.jpg not downloaded yet
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_c2e50600fb740f6621ba68f291af5f58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_c2e50600fb740f6621ba68f291af5f58.jpg not downloaded yet
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_ae3bb301eaab10a361568c659590151b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_ae3bb301eaab10a361568c659590151b.jpg not downloaded yet
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_f55434a81604e59e61b86da2cb49f748.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_f55434a81604e59e61b86da2cb49f748.jpg not downloaded yet
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_83f90ee66bf1fd2276961319969de007.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_83f90ee66bf1fd2276961319969de007.jpg not downloaded yet
2026-03-30 11:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_fdca12a8e7219be585c0cfe7b11cc6d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_c2e50600fb740f6621ba68f291af5f58.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_24dddf18e5ed2fa5ccfe62fb06191754.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_24dddf18e5ed2fa5ccfe62fb06191754.jpg not downloaded yet
2026-03-30 11:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_f55434a81604e59e61b86da2cb49f748.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_24dddf18e5ed2fa5ccfe62fb06191754.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78d410>
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_fdca12a8e7219be585c0cfe7b11cc6d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_fdca12a8e7219be585c0cfe7b11cc6d1.jpg saved to cache
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f653433c-18e0-54b4-853c-a0c4951018b7
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb14590>
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_c2e50600fb740f6621ba68f291af5f58.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_c2e50600fb740f6621ba68f291af5f58.jpg saved to cache
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f653433c-18e0-54b4-853c-a0c4951018b7
2026-03-30 11:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_83f90ee66bf1fd2276961319969de007.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_ae3bb301eaab10a361568c659590151b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca91410>
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_f55434a81604e59e61b86da2cb49f748.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_f55434a81604e59e61b86da2cb49f748.jpg saved to cache
2026-03-30 11:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f653433c-18e0-54b4-853c-a0c4951018b7
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6db350>
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_24dddf18e5ed2fa5ccfe62fb06191754.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_24dddf18e5ed2fa5ccfe62fb06191754.jpg saved to cache
2026-03-30 11:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f653433c-18e0-54b4-853c-a0c4951018b7
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc99ab10>
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_83f90ee66bf1fd2276961319969de007.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_83f90ee66bf1fd2276961319969de007.jpg saved to cache
2026-03-30 11:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f653433c-18e0-54b4-853c-a0c4951018b7
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dd6e0b10>
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F46%252F114678258ca61715cb9c2bb240427006%252Fpa%252FMD90216_ae3bb301eaab10a361568c659590151b.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_ae3bb301eaab10a361568c659590151b.jpg saved to cache
2026-03-30 11:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f653433c-18e0-54b4-853c-a0c4951018b7
2026-03-30 11:48:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f653433c-18e0-54b4-853c-a0c4951018b7, skipping ID generation
2026-03-30 11:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f653433c-18e0-54b4-853c-a0c4951018b7 with scrape type 1
2026-03-30 11:48:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f653433c-18e0-54b4-853c-a0c4951018b7 sending to next pipeline
2026-03-30 11:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f653433c-18e0-54b4-853c-a0c4951018b7, identifier: MD90216
2026-03-30 11:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f653433c-18e0-54b4-853c-a0c4951018b7 with identifier: MD90216
2026-03-30 11:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f653433c-18e0-54b4-853c-a0c4951018b7 with identifier: MD90216
2026-03-30 11:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f653433c-18e0-54b4-853c-a0c4951018b7 with identifier: MD90216 to the API
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_ae3bb301eaab10a361568c659590151b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:52:21Z',
 'fuel_type': 'diesel',
 'id': 'f653433c-18e0-54b4-853c-a0c4951018b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD90216',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 181232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_fdca12a8e7219be585c0cfe7b11cc6d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_c2e50600fb740f6621ba68f291af5f58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_ae3bb301eaab10a361568c659590151b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_f55434a81604e59e61b86da2cb49f748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_83f90ee66bf1fd2276961319969de007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f653433c-18e0-54b4-853c-a0c4951018b7/f653433c-18e0-54b4-853c-a0c4951018b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/46/114678258ca61715cb9c2bb240427006/pa/MD90216_24dddf18e5ed2fa5ccfe62fb06191754.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD90216%27 HTTP/1.1" 200 None
2026-03-30 11:48:15 [auto1.be] INFO: Saving data for MD90216: {'created_time': 1774871295.648891, 'last_price_update_time': 1774871295.648904, 'auction_closing_time': 1774972341.0}
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD90216') HTTP/1.1" 204 0
2026-03-30 11:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF91035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP60001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP57760> (referer: https://www.auto1.com/v1/car-details-view/AP57760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea9ad5b4-142a-5613-a24d-4e7d826b0374 with identifier: AP57760
2026-03-30 11:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea9ad5b4-142a-5613-a24d-4e7d826b0374 with scrape type 1
2026-03-30 11:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ea9ad5b4-142a-5613-a24d-4e7d826b0374
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_fe4aa7f8a14b9cfd1d85ede75131282b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_fe4aa7f8a14b9cfd1d85ede75131282b.jpg not downloaded yet
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_d64a87cef935a2b0d1ab1e18d536874b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_d64a87cef935a2b0d1ab1e18d536874b.jpg not downloaded yet
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_56497c87a053bf6a3203613c1f00450a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_56497c87a053bf6a3203613c1f00450a.jpg not downloaded yet
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_37d7ecb48243f1f07619eda5d93cbed9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_37d7ecb48243f1f07619eda5d93cbed9.jpg not downloaded yet
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_659113f0973f6ee0f3a227fee709feb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_659113f0973f6ee0f3a227fee709feb0.jpg not downloaded yet
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_a4d6ff009d5ae78f0bbfd898d4445a02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_a4d6ff009d5ae78f0bbfd898d4445a02.jpg not downloaded yet
2026-03-30 11:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_fe4aa7f8a14b9cfd1d85ede75131282b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_d64a87cef935a2b0d1ab1e18d536874b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_56497c87a053bf6a3203613c1f00450a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5bf990>
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_fe4aa7f8a14b9cfd1d85ede75131282b.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_fe4aa7f8a14b9cfd1d85ede75131282b.jpg saved to cache
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea9ad5b4-142a-5613-a24d-4e7d826b0374
2026-03-30 11:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_37d7ecb48243f1f07619eda5d93cbed9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc8d91d0>
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_d64a87cef935a2b0d1ab1e18d536874b.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_d64a87cef935a2b0d1ab1e18d536874b.jpg saved to cache
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea9ad5b4-142a-5613-a24d-4e7d826b0374
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca92e50>
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_56497c87a053bf6a3203613c1f00450a.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_56497c87a053bf6a3203613c1f00450a.jpg saved to cache
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea9ad5b4-142a-5613-a24d-4e7d826b0374
2026-03-30 11:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_a4d6ff009d5ae78f0bbfd898d4445a02.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc93b190>
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_37d7ecb48243f1f07619eda5d93cbed9.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_37d7ecb48243f1f07619eda5d93cbed9.jpg saved to cache
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea9ad5b4-142a-5613-a24d-4e7d826b0374
2026-03-30 11:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_659113f0973f6ee0f3a227fee709feb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca1a650>
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_a4d6ff009d5ae78f0bbfd898d4445a02.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_a4d6ff009d5ae78f0bbfd898d4445a02.jpg saved to cache
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea9ad5b4-142a-5613-a24d-4e7d826b0374
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81c7d0>
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F8b%252F578b9f553ea4e092cbbf3094e92b656d%252Fpa%252FAP57760_659113f0973f6ee0f3a227fee709feb0.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_659113f0973f6ee0f3a227fee709feb0.jpg saved to cache
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea9ad5b4-142a-5613-a24d-4e7d826b0374
2026-03-30 11:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea9ad5b4-142a-5613-a24d-4e7d826b0374, skipping ID generation
2026-03-30 11:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea9ad5b4-142a-5613-a24d-4e7d826b0374 with scrape type 1
2026-03-30 11:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea9ad5b4-142a-5613-a24d-4e7d826b0374 sending to next pipeline
2026-03-30 11:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea9ad5b4-142a-5613-a24d-4e7d826b0374, identifier: AP57760
2026-03-30 11:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea9ad5b4-142a-5613-a24d-4e7d826b0374 with identifier: AP57760
2026-03-30 11:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea9ad5b4-142a-5613-a24d-4e7d826b0374 with identifier: AP57760
2026-03-30 11:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea9ad5b4-142a-5613-a24d-4e7d826b0374 with identifier: AP57760 to the API
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_659113f0973f6ee0f3a227fee709feb0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:27:03Z',
 'fuel_type': 'petrol',
 'id': 'ea9ad5b4-142a-5613-a24d-4e7d826b0374',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP57760',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 152042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_fe4aa7f8a14b9cfd1d85ede75131282b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_d64a87cef935a2b0d1ab1e18d536874b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_56497c87a053bf6a3203613c1f00450a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_37d7ecb48243f1f07619eda5d93cbed9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_659113f0973f6ee0f3a227fee709feb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea9ad5b4-142a-5613-a24d-4e7d826b0374/ea9ad5b4-142a-5613-a24d-4e7d826b0374_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/8b/578b9f553ea4e092cbbf3094e92b656d/pa/AP57760_a4d6ff009d5ae78f0bbfd898d4445a02.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP57760%27 HTTP/1.1" 200 None
2026-03-30 11:48:29 [auto1.be] INFO: Saving data for AP57760: {'created_time': 1774871309.834579, 'last_price_update_time': 1774871309.834588, 'auction_closing_time': 1774970823.0}
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP57760') HTTP/1.1" 204 0
2026-03-30 11:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP17149/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC52442> (referer: https://www.auto1.com/v1/car-details-view/AC52442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08fb576f-0d64-5c8d-b8b6-deedffe54e01 with identifier: AC52442
2026-03-30 11:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01 with scrape type 1
2026-03-30 11:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_37b8e12291defe01e4b472e0ff1864bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_37b8e12291defe01e4b472e0ff1864bd.jpg not downloaded yet
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_0bfc090da5dcc8015126c8fc5559487d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_0bfc090da5dcc8015126c8fc5559487d.jpg not downloaded yet
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_84d9e92f62f24cb2f298f736849bf8f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_84d9e92f62f24cb2f298f736849bf8f0.jpg not downloaded yet
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_09969258b9cbfc7f40f7915056775070.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_09969258b9cbfc7f40f7915056775070.jpg not downloaded yet
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_93315afee78995a7208e8b166e2771a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_93315afee78995a7208e8b166e2771a6.jpg not downloaded yet
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_df1e21c39d1efbaeba0f6d9f5c9130cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_df1e21c39d1efbaeba0f6d9f5c9130cd.jpg not downloaded yet
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_1f0808ee613f51717dbc14380fb0d404.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_1f0808ee613f51717dbc14380fb0d404.jpg not downloaded yet
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_37b8e12291defe01e4b472e0ff1864bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_ebc4751f78b0448026c24fb0fba14a0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_ebc4751f78b0448026c24fb0fba14a0a.jpg not downloaded yet
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_84d9e92f62f24cb2f298f736849bf8f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_d7b86c3979264b877776dd366f4d126e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_d7b86c3979264b877776dd366f4d126e.jpg not downloaded yet
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_09969258b9cbfc7f40f7915056775070.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_f600df7fdb6f31125f0ba4723d9eb0dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_f600df7fdb6f31125f0ba4723d9eb0dd.jpg not downloaded yet
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_93315afee78995a7208e8b166e2771a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_f600df7fdb6f31125f0ba4723d9eb0dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78c750>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_37b8e12291defe01e4b472e0ff1864bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_37b8e12291defe01e4b472e0ff1864bd.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_0bfc090da5dcc8015126c8fc5559487d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc93ac90>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_84d9e92f62f24cb2f298f736849bf8f0.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_84d9e92f62f24cb2f298f736849bf8f0.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5e3c90>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_09969258b9cbfc7f40f7915056775070.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_09969258b9cbfc7f40f7915056775070.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9289d0>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_93315afee78995a7208e8b166e2771a6.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_93315afee78995a7208e8b166e2771a6.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_df1e21c39d1efbaeba0f6d9f5c9130cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_1f0808ee613f51717dbc14380fb0d404.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_ebc4751f78b0448026c24fb0fba14a0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_d7b86c3979264b877776dd366f4d126e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP60001> (referer: https://www.auto1.com/v1/car-details-view/MP60001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ac190>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_f600df7fdb6f31125f0ba4723d9eb0dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_f600df7fdb6f31125f0ba4723d9eb0dd.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dd6ffe10>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_0bfc090da5dcc8015126c8fc5559487d.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_0bfc090da5dcc8015126c8fc5559487d.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78ea90>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_df1e21c39d1efbaeba0f6d9f5c9130cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_df1e21c39d1efbaeba0f6d9f5c9130cd.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0ff90>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_1f0808ee613f51717dbc14380fb0d404.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_1f0808ee613f51717dbc14380fb0d404.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6da5d0>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_ebc4751f78b0448026c24fb0fba14a0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_ebc4751f78b0448026c24fb0fba14a0a.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dd713290>
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd8%252Ff6d8f5fbe744b5ad1447fb5eb1674b4f%252Fpa%252FAC52442_d7b86c3979264b877776dd366f4d126e.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_d7b86c3979264b877776dd366f4d126e.jpg saved to cache
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01
2026-03-30 11:48:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08fb576f-0d64-5c8d-b8b6-deedffe54e01, skipping ID generation
2026-03-30 11:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01 with scrape type 1
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08fb576f-0d64-5c8d-b8b6-deedffe54e01 sending to next pipeline
2026-03-30 11:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 08fb576f-0d64-5c8d-b8b6-deedffe54e01, identifier: AC52442
2026-03-30 11:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f402372-9ab6-5e36-bb5d-505c11182da3 with identifier: MP60001
2026-03-30 11:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f402372-9ab6-5e36-bb5d-505c11182da3 with scrape type 1
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f402372-9ab6-5e36-bb5d-505c11182da3
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_2fec74508c183953b97c418f2c14735a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_2fec74508c183953b97c418f2c14735a.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_dbadd6a2cd210afa717400579c13996c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_dbadd6a2cd210afa717400579c13996c.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_007eba0161097ffb1d4b90fe982fbf1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_007eba0161097ffb1d4b90fe982fbf1a.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_b15f46cfbb91489d3d2574436b39c670.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_b15f46cfbb91489d3d2574436b39c670.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_2573171cdbb5cc701ee50f480e6c3120.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_2573171cdbb5cc701ee50f480e6c3120.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_98d73b50af69934b1274b5933c515ef5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_98d73b50af69934b1274b5933c515ef5.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_5dbc0c63cbf3bf8474284699c47d68e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_5dbc0c63cbf3bf8474284699c47d68e8.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_55925a64a9223c299f3d942f4b91cc02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_55925a64a9223c299f3d942f4b91cc02.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_9cc611d8b8d0a21d87a71bb5ab17f741.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_9cc611d8b8d0a21d87a71bb5ab17f741.jpg already downloaded
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F82%252F9082fe0d1ee48f96c7ed2940ee576636%252Fpa%252FMP60001_b1a7b10f30569f8e9330f7c0301743a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_b1a7b10f30569f8e9330f7c0301743a9.jpg already downloaded
2026-03-30 11:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f402372-9ab6-5e36-bb5d-505c11182da3, identifier: MP60001
2026-03-30 11:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 08fb576f-0d64-5c8d-b8b6-deedffe54e01 with identifier: AC52442
2026-03-30 11:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 08fb576f-0d64-5c8d-b8b6-deedffe54e01 with identifier: AC52442
2026-03-30 11:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 08fb576f-0d64-5c8d-b8b6-deedffe54e01 with identifier: AC52442 to the API
2026-03-30 11:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_d7b86c3979264b877776dd366f4d126e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.1L',
 'engine_horse_power': 209,
 'expiration_date': '2026-03-31T15:36:30Z',
 'fuel_type': 'diesel',
 'id': '08fb576f-0d64-5c8d-b8b6-deedffe54e01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC52442',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 166995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_37b8e12291defe01e4b472e0ff1864bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_0bfc090da5dcc8015126c8fc5559487d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_84d9e92f62f24cb2f298f736849bf8f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_09969258b9cbfc7f40f7915056775070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_93315afee78995a7208e8b166e2771a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_df1e21c39d1efbaeba0f6d9f5c9130cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_1f0808ee613f51717dbc14380fb0d404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_ebc4751f78b0448026c24fb0fba14a0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_d7b86c3979264b877776dd366f4d126e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08fb576f-0d64-5c8d-b8b6-deedffe54e01/08fb576f-0d64-5c8d-b8b6-deedffe54e01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d8/f6d8f5fbe744b5ad1447fb5eb1674b4f/pa/AC52442_f600df7fdb6f31125f0ba4723d9eb0dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
 'transmission': 'automatic',
 'trim': 'Veloce Q4',
 'year': 2020}
2026-03-30 11:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC52442%27 HTTP/1.1" 200 None
2026-03-30 11:48:37 [auto1.be] INFO: Saving data for AC52442: {'created_time': 1774871317.948523, 'last_price_update_time': 1774871317.948535, 'auction_closing_time': 1774971390.0}
2026-03-30 11:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AC52442') HTTP/1.1" 204 0
2026-03-30 11:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f402372-9ab6-5e36-bb5d-505c11182da3 with identifier: MP60001
2026-03-30 11:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f402372-9ab6-5e36-bb5d-505c11182da3 with identifier: MP60001
2026-03-30 11:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f402372-9ab6-5e36-bb5d-505c11182da3 with identifier: MP60001 to the API
2026-03-30 11:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP60001>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:29:09Z',
 'fuel_type': 'petrol',
 'id': '4f402372-9ab6-5e36-bb5d-505c11182da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP60001',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 16583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_2fec74508c183953b97c418f2c14735a.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_dbadd6a2cd210afa717400579c13996c.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_007eba0161097ffb1d4b90fe982fbf1a.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_b15f46cfbb91489d3d2574436b39c670.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_2573171cdbb5cc701ee50f480e6c3120.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_98d73b50af69934b1274b5933c515ef5.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_5dbc0c63cbf3bf8474284699c47d68e8.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_55925a64a9223c299f3d942f4b91cc02.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_9cc611d8b8d0a21d87a71bb5ab17f741.jpg',
                'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_b1a7b10f30569f8e9330f7c0301743a9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4146192,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_2fec74508c183953b97c418f2c14735a.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_dbadd6a2cd210afa717400579c13996c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_007eba0161097ffb1d4b90fe982fbf1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_b15f46cfbb91489d3d2574436b39c670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_2573171cdbb5cc701ee50f480e6c3120.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_98d73b50af69934b1274b5933c515ef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_5dbc0c63cbf3bf8474284699c47d68e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_55925a64a9223c299f3d942f4b91cc02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_9cc611d8b8d0a21d87a71bb5ab17f741.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f402372-9ab6-5e36-bb5d-505c11182da3/4f402372-9ab6-5e36-bb5d-505c11182da3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/82/9082fe0d1ee48f96c7ed2940ee576636/pa/MP60001_b1a7b10f30569f8e9330f7c0301743a9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2019}
2026-03-30 11:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP60001%27 HTTP/1.1" 200 None
2026-03-30 11:48:38 [auto1.be] INFO: Saving data for MP60001: {'created_time': 1774871318.275033, 'last_price_update_time': 1774871318.275043, 'auction_closing_time': 1774970949.0}
2026-03-30 11:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MP60001') HTTP/1.1" 204 0
2026-03-30 11:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP17149> (referer: https://www.auto1.com/v1/car-details-view/LP17149/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6e6435e-955f-5317-9d32-08fcb656deb6 with identifier: LP17149
2026-03-30 11:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e6435e-955f-5317-9d32-08fcb656deb6 with scrape type 1
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_ba639e701c81f803e56e2e3f9a7b8b12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_ba639e701c81f803e56e2e3f9a7b8b12.jpg not downloaded yet
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_8f3cf961b534385e6ece068358180f16.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_8f3cf961b534385e6ece068358180f16.jpg not downloaded yet
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_e673614ec83a4a165739b9eb37c07854.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e673614ec83a4a165739b9eb37c07854.jpg not downloaded yet
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_17145bc8978cda933981e0377107a64b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_17145bc8978cda933981e0377107a64b.jpg not downloaded yet
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_65a195f1c5ac2d4c0982b453408a93fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_65a195f1c5ac2d4c0982b453408a93fd.jpg not downloaded yet
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_c1ae70ff4c5d8dab42805ed65593aad5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_c1ae70ff4c5d8dab42805ed65593aad5.jpg not downloaded yet
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_2de27b7eac9e69f3358bd803bebd8cc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_2de27b7eac9e69f3358bd803bebd8cc8.jpg not downloaded yet
2026-03-30 11:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_ba639e701c81f803e56e2e3f9a7b8b12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_aec104757bdbdd5e1223056b708bb173.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_aec104757bdbdd5e1223056b708bb173.jpg not downloaded yet
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_e616ca0e7bf9d606ed746fd60d1039fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e616ca0e7bf9d606ed746fd60d1039fb.jpg not downloaded yet
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_3b64c28f6fe5be2b9066784d7024885d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_3b64c28f6fe5be2b9066784d7024885d.jpg not downloaded yet
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73debe8c10>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_ba639e701c81f803e56e2e3f9a7b8b12.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_ba639e701c81f803e56e2e3f9a7b8b12.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_8f3cf961b534385e6ece068358180f16.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_17145bc8978cda933981e0377107a64b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e673614ec83a4a165739b9eb37c07854.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_65a195f1c5ac2d4c0982b453408a93fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_3b64c28f6fe5be2b9066784d7024885d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_c1ae70ff4c5d8dab42805ed65593aad5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_aec104757bdbdd5e1223056b708bb173.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e616ca0e7bf9d606ed746fd60d1039fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b87d0>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_8f3cf961b534385e6ece068358180f16.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_8f3cf961b534385e6ece068358180f16.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc727e90>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_17145bc8978cda933981e0377107a64b.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_17145bc8978cda933981e0377107a64b.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_2de27b7eac9e69f3358bd803bebd8cc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81a050>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_e673614ec83a4a165739b9eb37c07854.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e673614ec83a4a165739b9eb37c07854.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5d1a90>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_65a195f1c5ac2d4c0982b453408a93fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_65a195f1c5ac2d4c0982b453408a93fd.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75ee10>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_3b64c28f6fe5be2b9066784d7024885d.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_3b64c28f6fe5be2b9066784d7024885d.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc917e10>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_c1ae70ff4c5d8dab42805ed65593aad5.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_c1ae70ff4c5d8dab42805ed65593aad5.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b1910>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_aec104757bdbdd5e1223056b708bb173.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_aec104757bdbdd5e1223056b708bb173.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc903dd0>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_e616ca0e7bf9d606ed746fd60d1039fb.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e616ca0e7bf9d606ed746fd60d1039fb.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b3890>
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Faa%252F6eaa626f451c4d10dbe56a312547bccc%252Fpa%252FLP17149_2de27b7eac9e69f3358bd803bebd8cc8.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_2de27b7eac9e69f3358bd803bebd8cc8.jpg saved to cache
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6e6435e-955f-5317-9d32-08fcb656deb6
2026-03-30 11:48:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6e6435e-955f-5317-9d32-08fcb656deb6, skipping ID generation
2026-03-30 11:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e6435e-955f-5317-9d32-08fcb656deb6 with scrape type 1
2026-03-30 11:48:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6e6435e-955f-5317-9d32-08fcb656deb6 sending to next pipeline
2026-03-30 11:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d6e6435e-955f-5317-9d32-08fcb656deb6, identifier: LP17149
2026-03-30 11:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d6e6435e-955f-5317-9d32-08fcb656deb6 with identifier: LP17149
2026-03-30 11:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d6e6435e-955f-5317-9d32-08fcb656deb6 with identifier: LP17149
2026-03-30 11:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d6e6435e-955f-5317-9d32-08fcb656deb6 with identifier: LP17149 to the API
2026-03-30 11:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_2de27b7eac9e69f3358bd803bebd8cc8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-31T15:07:37Z',
 'fuel_type': 'petrol',
 'id': 'd6e6435e-955f-5317-9d32-08fcb656deb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP17149',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 267431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_ba639e701c81f803e56e2e3f9a7b8b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_8f3cf961b534385e6ece068358180f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e673614ec83a4a165739b9eb37c07854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_17145bc8978cda933981e0377107a64b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_65a195f1c5ac2d4c0982b453408a93fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_c1ae70ff4c5d8dab42805ed65593aad5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_2de27b7eac9e69f3358bd803bebd8cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_aec104757bdbdd5e1223056b708bb173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_e616ca0e7bf9d606ed746fd60d1039fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e6435e-955f-5317-9d32-08fcb656deb6/d6e6435e-955f-5317-9d32-08fcb656deb6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/aa/6eaa626f451c4d10dbe56a312547bccc/pa/LP17149_3b64c28f6fe5be2b9066784d7024885d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Note 1.4 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2007}
2026-03-30 11:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP17149%27 HTTP/1.1" 200 None
2026-03-30 11:48:45 [auto1.be] INFO: Saving data for LP17149: {'created_time': 1774871325.277238, 'last_price_update_time': 1774871325.277248, 'auction_closing_time': 1774969657.0}
2026-03-30 11:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP17149') HTTP/1.1" 204 0
2026-03-30 11:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF91035> (referer: https://www.auto1.com/v1/car-details-view/SF91035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a5dce5-dc24-5fef-a5e0-f55b803c3bed with identifier: SF91035
2026-03-30 11:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a5dce5-dc24-5fef-a5e0-f55b803c3bed with scrape type 1
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8a5dce5-dc24-5fef-a5e0-f55b803c3bed
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_43708a39861be8ad24d7e34cd507bf0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_43708a39861be8ad24d7e34cd507bf0f.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_fb9c3efe36773f4e9ca580ce3022f07f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_fb9c3efe36773f4e9ca580ce3022f07f.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_e51186bad981adc66d5785ee6c6d5659.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_e51186bad981adc66d5785ee6c6d5659.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_2950c566930521563c40346123a61419.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_2950c566930521563c40346123a61419.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_0227e4ee438b35ab948869e706e68d4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_0227e4ee438b35ab948869e706e68d4d.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_c2324fd32eaf4fba913b50aecab36816.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_c2324fd32eaf4fba913b50aecab36816.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_73276a1a1b85be4867caa8370651cb2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_73276a1a1b85be4867caa8370651cb2f.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_3e90ce020b420f5250f72c68ff8aecd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_3e90ce020b420f5250f72c68ff8aecd2.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_b33eee703675f58c6f85ea057aef9e4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_b33eee703675f58c6f85ea057aef9e4c.jpg already downloaded
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F36463ea375c7ebfab007f84ec3980ff9%252Fpa%252FSF91035_29db94edeb5508d232dfe9e2579616a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_29db94edeb5508d232dfe9e2579616a8.jpg already downloaded
2026-03-30 11:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8a5dce5-dc24-5fef-a5e0-f55b803c3bed, identifier: SF91035
2026-03-30 11:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8a5dce5-dc24-5fef-a5e0-f55b803c3bed with identifier: SF91035
2026-03-30 11:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8a5dce5-dc24-5fef-a5e0-f55b803c3bed with identifier: SF91035
2026-03-30 11:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8a5dce5-dc24-5fef-a5e0-f55b803c3bed with identifier: SF91035 to the API
2026-03-30 11:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF91035>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:53:00Z',
 'fuel_type': 'petrol',
 'id': 'c8a5dce5-dc24-5fef-a5e0-f55b803c3bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF91035',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'DS3 Cabrio',
 'odometer': 174097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_43708a39861be8ad24d7e34cd507bf0f.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_fb9c3efe36773f4e9ca580ce3022f07f.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_e51186bad981adc66d5785ee6c6d5659.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_2950c566930521563c40346123a61419.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_0227e4ee438b35ab948869e706e68d4d.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_c2324fd32eaf4fba913b50aecab36816.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_73276a1a1b85be4867caa8370651cb2f.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_3e90ce020b420f5250f72c68ff8aecd2.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_b33eee703675f58c6f85ea057aef9e4c.jpg',
                'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_29db94edeb5508d232dfe9e2579616a8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1497463,
             'Height': 905,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_43708a39861be8ad24d7e34cd507bf0f.jpg',
             'Width': 1206},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_fb9c3efe36773f4e9ca580ce3022f07f.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_e51186bad981adc66d5785ee6c6d5659.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_2950c566930521563c40346123a61419.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_0227e4ee438b35ab948869e706e68d4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_c2324fd32eaf4fba913b50aecab36816.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_73276a1a1b85be4867caa8370651cb2f.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_3e90ce020b420f5250f72c68ff8aecd2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_b33eee703675f58c6f85ea057aef9e4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a5dce5-dc24-5fef-a5e0-f55b803c3bed/c8a5dce5-dc24-5fef-a5e0-f55b803c3bed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/46/36463ea375c7ebfab007f84ec3980ff9/pa/SF91035_29db94edeb5508d232dfe9e2579616a8.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen DS3 Cabrio 1.6 THP SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2013}
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF91035%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.be] INFO: Saving data for SF91035: {'created_time': 1774871335.243858, 'last_price_update_time': 1774871335.24387, 'auction_closing_time': 1774972380.0}
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SF91035') HTTP/1.1" 204 0
2026-03-30 11:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ36131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ36131> (referer: https://www.auto1.com/v1/car-details-view/XZ36131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f07f5cf3-582b-5277-b5b6-af4e176278b2 with identifier: XZ36131
2026-03-30 11:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f07f5cf3-582b-5277-b5b6-af4e176278b2 with scrape type 1
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_780d50ac1914f988b21eca431457b9b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_780d50ac1914f988b21eca431457b9b7.jpg not downloaded yet
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_5bc23662382ba615ea953a2e8fff4bac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_5bc23662382ba615ea953a2e8fff4bac.jpg not downloaded yet
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_038fb8a44a320bcbcfa18c6ac2ec0ced.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_038fb8a44a320bcbcfa18c6ac2ec0ced.jpg not downloaded yet
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_a6cf95f88898e3f3e7b0330e6765e61c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a6cf95f88898e3f3e7b0330e6765e61c.jpg not downloaded yet
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_b5a4c408ffa7e9dfb5752ba74027f8d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_b5a4c408ffa7e9dfb5752ba74027f8d5.jpg not downloaded yet
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_7131bd543980b8ebd7e46d5cdbb4a046.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_7131bd543980b8ebd7e46d5cdbb4a046.jpg not downloaded yet
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_5bc23662382ba615ea953a2e8fff4bac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_780d50ac1914f988b21eca431457b9b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_6a0f0edf40e3ef2ab227246dcca10dae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_6a0f0edf40e3ef2ab227246dcca10dae.jpg not downloaded yet
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_3e2792a25ad9ac98c26073b6b10f7446.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_3e2792a25ad9ac98c26073b6b10f7446.jpg not downloaded yet
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_43c5a64c6e1e0537dfae5153ebb292bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_43c5a64c6e1e0537dfae5153ebb292bc.jpg not downloaded yet
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a6cf95f88898e3f3e7b0330e6765e61c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_a2e3afad50bfb25fd0555dce281897e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a2e3afad50bfb25fd0555dce281897e9.jpg not downloaded yet
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc78a290>
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_5bc23662382ba615ea953a2e8fff4bac.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_5bc23662382ba615ea953a2e8fff4bac.jpg saved to cache
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca4ff10>
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_780d50ac1914f988b21eca431457b9b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_780d50ac1914f988b21eca431457b9b7.jpg saved to cache
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_038fb8a44a320bcbcfa18c6ac2ec0ced.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_6a0f0edf40e3ef2ab227246dcca10dae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_43c5a64c6e1e0537dfae5153ebb292bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_7131bd543980b8ebd7e46d5cdbb4a046.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc701dd0>
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_a6cf95f88898e3f3e7b0330e6765e61c.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a6cf95f88898e3f3e7b0330e6765e61c.jpg saved to cache
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_b5a4c408ffa7e9dfb5752ba74027f8d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_3e2792a25ad9ac98c26073b6b10f7446.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a2e3afad50bfb25fd0555dce281897e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7b0250>
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_038fb8a44a320bcbcfa18c6ac2ec0ced.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_038fb8a44a320bcbcfa18c6ac2ec0ced.jpg saved to cache
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5e3e50>
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_6a0f0edf40e3ef2ab227246dcca10dae.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_6a0f0edf40e3ef2ab227246dcca10dae.jpg saved to cache
2026-03-30 11:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5bd210>
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_43c5a64c6e1e0537dfae5153ebb292bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_43c5a64c6e1e0537dfae5153ebb292bc.jpg saved to cache
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83fa10>
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_7131bd543980b8ebd7e46d5cdbb4a046.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_7131bd543980b8ebd7e46d5cdbb4a046.jpg saved to cache
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc901790>
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_b5a4c408ffa7e9dfb5752ba74027f8d5.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_b5a4c408ffa7e9dfb5752ba74027f8d5.jpg saved to cache
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6ec9d0>
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_3e2792a25ad9ac98c26073b6b10f7446.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_3e2792a25ad9ac98c26073b6b10f7446.jpg saved to cache
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc886710>
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F6e%252Fe16e1214cd79eae23f4bff3df2efd32c%252Fpa%252FXZ36131_a2e3afad50bfb25fd0555dce281897e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a2e3afad50bfb25fd0555dce281897e9.jpg saved to cache
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f07f5cf3-582b-5277-b5b6-af4e176278b2
2026-03-30 11:48:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f07f5cf3-582b-5277-b5b6-af4e176278b2, skipping ID generation
2026-03-30 11:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f07f5cf3-582b-5277-b5b6-af4e176278b2 with scrape type 1
2026-03-30 11:48:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f07f5cf3-582b-5277-b5b6-af4e176278b2 sending to next pipeline
2026-03-30 11:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f07f5cf3-582b-5277-b5b6-af4e176278b2, identifier: XZ36131
2026-03-30 11:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f07f5cf3-582b-5277-b5b6-af4e176278b2 with identifier: XZ36131
2026-03-30 11:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f07f5cf3-582b-5277-b5b6-af4e176278b2 with identifier: XZ36131
2026-03-30 11:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f07f5cf3-582b-5277-b5b6-af4e176278b2 with identifier: XZ36131 to the API
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a2e3afad50bfb25fd0555dce281897e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:17:19Z',
 'fuel_type': 'petrol',
 'id': 'f07f5cf3-582b-5277-b5b6-af4e176278b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ36131',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 74381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_780d50ac1914f988b21eca431457b9b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_5bc23662382ba615ea953a2e8fff4bac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_038fb8a44a320bcbcfa18c6ac2ec0ced.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a6cf95f88898e3f3e7b0330e6765e61c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_b5a4c408ffa7e9dfb5752ba74027f8d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_7131bd543980b8ebd7e46d5cdbb4a046.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_6a0f0edf40e3ef2ab227246dcca10dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_3e2792a25ad9ac98c26073b6b10f7446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_43c5a64c6e1e0537dfae5153ebb292bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f07f5cf3-582b-5277-b5b6-af4e176278b2/f07f5cf3-582b-5277-b5b6-af4e176278b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/6e/e16e1214cd79eae23f4bff3df2efd32c/pa/XZ36131_a2e3afad50bfb25fd0555dce281897e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2018}
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ36131%27 HTTP/1.1" 200 None
2026-03-30 11:48:59 [auto1.be] INFO: Saving data for XZ36131: {'created_time': 1774871339.657624, 'last_price_update_time': 1774871339.657635, 'auction_closing_time': 1774970239.0}
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ36131') HTTP/1.1" 204 0
2026-03-30 11:49:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.997(s), this was the 1st time calling it.
2026-03-30 11:49:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.61623740676978 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:49:06 [scrapy.extensions.logstats] INFO: Crawled 187 pages (at 14 pages/min), scraped 126 items (at 8 items/min)
2026-03-30 11:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:49:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL15849> (referer: https://www.auto1.com/v1/car-details-view/CL15849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 493ebc5b-210e-53bb-ace6-c1221e59dc6b with identifier: CL15849
2026-03-30 11:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b with scrape type 1
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_66acf292d45aaa030883c3d9ddb84832.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_66acf292d45aaa030883c3d9ddb84832.jpg not downloaded yet
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_295a1270a7b8833588e6c126b9e5ef60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_295a1270a7b8833588e6c126b9e5ef60.jpg not downloaded yet
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_676f2fed1c1f0f1aced07a02d3e4175d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_676f2fed1c1f0f1aced07a02d3e4175d.jpg not downloaded yet
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_8d330c4dda5a5400c0403e85215dec64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d330c4dda5a5400c0403e85215dec64.jpg not downloaded yet
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_6409f1a74ab41845cdae68a6779f07e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_6409f1a74ab41845cdae68a6779f07e8.jpg not downloaded yet
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_adae2364e7931951290bcc5df123bc4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_adae2364e7931951290bcc5df123bc4f.jpg not downloaded yet
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_539b836bd9dbc7f6bff955e4f74c5cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_539b836bd9dbc7f6bff955e4f74c5cb6.jpg not downloaded yet
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_549cad181f32bd24ad725e36b46e683c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_549cad181f32bd24ad725e36b46e683c.jpg not downloaded yet
2026-03-30 11:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_66acf292d45aaa030883c3d9ddb84832.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_8d46076c0e2f6d6acd34120b4a32bd1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d46076c0e2f6d6acd34120b4a32bd1a.jpg not downloaded yet
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_c7b616f3e719165f9fb56524bed15794.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_c7b616f3e719165f9fb56524bed15794.jpg not downloaded yet
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_676f2fed1c1f0f1aced07a02d3e4175d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_295a1270a7b8833588e6c126b9e5ef60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73ec4ddad0>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_66acf292d45aaa030883c3d9ddb84832.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_66acf292d45aaa030883c3d9ddb84832.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca1bed0>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_676f2fed1c1f0f1aced07a02d3e4175d.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_676f2fed1c1f0f1aced07a02d3e4175d.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_6409f1a74ab41845cdae68a6779f07e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d330c4dda5a5400c0403e85215dec64.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_c7b616f3e719165f9fb56524bed15794.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d8f10>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_295a1270a7b8833588e6c126b9e5ef60.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_295a1270a7b8833588e6c126b9e5ef60.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_adae2364e7931951290bcc5df123bc4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_549cad181f32bd24ad725e36b46e683c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d46076c0e2f6d6acd34120b4a32bd1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_539b836bd9dbc7f6bff955e4f74c5cb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc73f6d0>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_6409f1a74ab41845cdae68a6779f07e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_6409f1a74ab41845cdae68a6779f07e8.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0d450>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_8d330c4dda5a5400c0403e85215dec64.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d330c4dda5a5400c0403e85215dec64.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9393d0>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_c7b616f3e719165f9fb56524bed15794.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_c7b616f3e719165f9fb56524bed15794.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc72cad0>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_adae2364e7931951290bcc5df123bc4f.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_adae2364e7931951290bcc5df123bc4f.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca6f090>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_549cad181f32bd24ad725e36b46e683c.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_549cad181f32bd24ad725e36b46e683c.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc714810>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_8d46076c0e2f6d6acd34120b4a32bd1a.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d46076c0e2f6d6acd34120b4a32bd1a.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc974c50>
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6a%252F956a9aa907d00a39e4e6e21ffb2a34a9%252Fpa%252FCL15849_539b836bd9dbc7f6bff955e4f74c5cb6.jpg') HTTP/1.1" 204 0
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_539b836bd9dbc7f6bff955e4f74c5cb6.jpg saved to cache
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b
2026-03-30 11:49:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 493ebc5b-210e-53bb-ace6-c1221e59dc6b, skipping ID generation
2026-03-30 11:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b with scrape type 1
2026-03-30 11:49:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 493ebc5b-210e-53bb-ace6-c1221e59dc6b sending to next pipeline
2026-03-30 11:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 493ebc5b-210e-53bb-ace6-c1221e59dc6b, identifier: CL15849
2026-03-30 11:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 493ebc5b-210e-53bb-ace6-c1221e59dc6b with identifier: CL15849
2026-03-30 11:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 493ebc5b-210e-53bb-ace6-c1221e59dc6b with identifier: CL15849
2026-03-30 11:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 493ebc5b-210e-53bb-ace6-c1221e59dc6b with identifier: CL15849 to the API
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_539b836bd9dbc7f6bff955e4f74c5cb6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:25:44Z',
 'fuel_type': 'petrol',
 'id': '493ebc5b-210e-53bb-ace6-c1221e59dc6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL15849',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 155817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_66acf292d45aaa030883c3d9ddb84832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_295a1270a7b8833588e6c126b9e5ef60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_676f2fed1c1f0f1aced07a02d3e4175d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d330c4dda5a5400c0403e85215dec64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_6409f1a74ab41845cdae68a6779f07e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_adae2364e7931951290bcc5df123bc4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_539b836bd9dbc7f6bff955e4f74c5cb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_549cad181f32bd24ad725e36b46e683c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_8d46076c0e2f6d6acd34120b4a32bd1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_493ebc5b-210e-53bb-ace6-c1221e59dc6b/493ebc5b-210e-53bb-ace6-c1221e59dc6b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/6a/956a9aa907d00a39e4e6e21ffb2a34a9/pa/CL15849_c7b616f3e719165f9fb56524bed15794.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-30 11:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL15849%27 HTTP/1.1" 200 None
2026-03-30 11:49:21 [auto1.be] INFO: Saving data for CL15849: {'created_time': 1774871361.053227, 'last_price_update_time': 1774871361.053237, 'auction_closing_time': 1774970744.0}
2026-03-30 11:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CL15849') HTTP/1.1" 204 0
2026-03-30 11:50:06 [scrapy.extensions.logstats] INFO: Crawled 188 pages (at 1 pages/min), scraped 127 items (at 1 items/min)
2026-03-30 11:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:50:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.914(s), this was the 1st time calling it.
2026-03-30 11:50:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.90642032359236 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:50:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:50:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.017(s), this was the 1st time calling it.
2026-03-30 11:50:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.4943829070390615 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:25 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: UF38996
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: ED62480
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED62480%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for ED62480: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for SR71847: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: MS84357
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS84357%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for MS84357: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for SJ72272: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: MD91238
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD91238%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for MD91238: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for WN85390: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for FV41606: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: XC26287
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: YX69957
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX69957%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for YX69957: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: GS42296
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS42296%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for GS42296: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: XV45416
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: HL05710
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL05710%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for HL05710: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: NH80895
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH80895%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for NH80895: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for VW71513: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: GX79489
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: AU97754
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for YN20871: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: AH26966
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: YU57960
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for NJ53644: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: GD38693
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD38693%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for GD38693: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: PH52818
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH52818%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for PH52818: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: DA58595
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DA58595%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for DA58595: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: PL94274
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL94274%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for PL94274: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: MX38879
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX38879%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for MX38879: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: PK81975
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: JJ16156
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: BM50316
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BM50316%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.be] INFO: Scrape type for BM50316: 0
2026-03-30 11:50:25 [auto1.be] INFO: Found listing with ID: GF12513
2026-03-30 11:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF12513%27 HTTP/1.1" 200 None
2026-03-30 11:50:26 [auto1.be] INFO: Scrape type for GF12513: 0
2026-03-30 11:50:26 [auto1.be] INFO: Found listing with ID: JA60978
2026-03-30 11:50:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:28 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: RD04523
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD04523%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for RD04523: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: SG92006
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: PH13121
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: EF47293
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: GG54325
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG54325%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for GG54325: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: BH83667
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH83667%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for BH83667: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: DA89043
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DA89043%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for DA89043: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: AE99564
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: BC23498
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23498%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for BC23498: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: VP07407
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP07407%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for VP07407: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: JY99068
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: JC64183
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC64183%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for JC64183: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for LJ62513: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for XE18058: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: UY40990
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY40990%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for UY40990: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: CM92821
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM92821%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for CM92821: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for HM28534: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: TL00014
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for TS78695: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: YW02361
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW02361%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for YW02361: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: BC43211
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: JD88445
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: HH39749
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: WY71149
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY71149%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for WY71149: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: DJ79108
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ79108%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for DJ79108: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for LM02594: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: ER70694
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER70694%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for ER70694: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: UK31480
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK31480%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for UK31480: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: CN63024
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for CP45384: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: EB13238
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: NS58610
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS58610%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for NS58610: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for MD39375: 0
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: VK40214
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: KM41856
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: FG04950
2026-03-30 11:50:28 [auto1.be] INFO: Found listing with ID: SR54305
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR54305%27 HTTP/1.1" 200 None
2026-03-30 11:50:28 [auto1.be] INFO: Scrape type for SR54305: 0
2026-03-30 11:50:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.813(s), this was the 1st time calling it.
2026-03-30 11:50:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.238161867684545 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:50:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:50:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY15914> (referer: https://www.auto1.com/v1/car-details-view/UY15914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0235e64-f82d-519d-b54a-09321410c47e with identifier: UY15914
2026-03-30 11:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0235e64-f82d-519d-b54a-09321410c47e with scrape type 1
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_643972cc67b720afe9adf9b3510147e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_643972cc67b720afe9adf9b3510147e9.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_f9a570ca8003815711ca37b31a9152b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_f9a570ca8003815711ca37b31a9152b6.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_a0c01e9be0cdf84ccba498b556b539d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a0c01e9be0cdf84ccba498b556b539d1.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_0278a6e11fc78233aab70db69bf7adfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_0278a6e11fc78233aab70db69bf7adfa.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_2de6f1c63f6ea198126b9d953aee0ae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2de6f1c63f6ea198126b9d953aee0ae2.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_2489600aa3be7fb903cf5e974c8630db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2489600aa3be7fb903cf5e974c8630db.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_5bcf3b678d2604a64e00dfe6459bdeba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_5bcf3b678d2604a64e00dfe6459bdeba.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_ec64ff340a0da7f127336018604bd0ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_ec64ff340a0da7f127336018604bd0ae.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_a05ff733ade59be568e19c6cc70256b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a05ff733ade59be568e19c6cc70256b1.jpg not downloaded yet
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_c8e2bea3a48acdbe383a7e469b221b98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_c8e2bea3a48acdbe383a7e469b221b98.jpg not downloaded yet
2026-03-30 11:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_f9a570ca8003815711ca37b31a9152b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_643972cc67b720afe9adf9b3510147e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a05ff733ade59be568e19c6cc70256b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83cf90>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_f9a570ca8003815711ca37b31a9152b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_f9a570ca8003815711ca37b31a9152b6.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9b2590>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_643972cc67b720afe9adf9b3510147e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_643972cc67b720afe9adf9b3510147e9.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca6c3d0>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_a05ff733ade59be568e19c6cc70256b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a05ff733ade59be568e19c6cc70256b1.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2489600aa3be7fb903cf5e974c8630db.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_c8e2bea3a48acdbe383a7e469b221b98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a0c01e9be0cdf84ccba498b556b539d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_0278a6e11fc78233aab70db69bf7adfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2de6f1c63f6ea198126b9d953aee0ae2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_5bcf3b678d2604a64e00dfe6459bdeba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_ec64ff340a0da7f127336018604bd0ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc929110>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_2489600aa3be7fb903cf5e974c8630db.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2489600aa3be7fb903cf5e974c8630db.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc92ba10>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_c8e2bea3a48acdbe383a7e469b221b98.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_c8e2bea3a48acdbe383a7e469b221b98.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc81f9d0>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_a0c01e9be0cdf84ccba498b556b539d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a0c01e9be0cdf84ccba498b556b539d1.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc9891d0>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_0278a6e11fc78233aab70db69bf7adfa.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_0278a6e11fc78233aab70db69bf7adfa.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ac4d0>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_2de6f1c63f6ea198126b9d953aee0ae2.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2de6f1c63f6ea198126b9d953aee0ae2.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc7ba510>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_5bcf3b678d2604a64e00dfe6459bdeba.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_5bcf3b678d2604a64e00dfe6459bdeba.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc75b950>
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2a%252F5d2a83e6669920814c58f0b7eed885e4%252Fpa%252FUY15914_ec64ff340a0da7f127336018604bd0ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_ec64ff340a0da7f127336018604bd0ae.jpg saved to cache
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0235e64-f82d-519d-b54a-09321410c47e
2026-03-30 11:50:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0235e64-f82d-519d-b54a-09321410c47e, skipping ID generation
2026-03-30 11:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0235e64-f82d-519d-b54a-09321410c47e with scrape type 1
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0235e64-f82d-519d-b54a-09321410c47e sending to next pipeline
2026-03-30 11:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0235e64-f82d-519d-b54a-09321410c47e, identifier: UY15914
2026-03-30 11:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0235e64-f82d-519d-b54a-09321410c47e with identifier: UY15914
2026-03-30 11:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0235e64-f82d-519d-b54a-09321410c47e with identifier: UY15914
2026-03-30 11:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0235e64-f82d-519d-b54a-09321410c47e with identifier: UY15914 to the API
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_ec64ff340a0da7f127336018604bd0ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:45:50Z',
 'fuel_type': 'diesel',
 'id': 'c0235e64-f82d-519d-b54a-09321410c47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY15914',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 130301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_643972cc67b720afe9adf9b3510147e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_f9a570ca8003815711ca37b31a9152b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a0c01e9be0cdf84ccba498b556b539d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_0278a6e11fc78233aab70db69bf7adfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2de6f1c63f6ea198126b9d953aee0ae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_2489600aa3be7fb903cf5e974c8630db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_5bcf3b678d2604a64e00dfe6459bdeba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_ec64ff340a0da7f127336018604bd0ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_a05ff733ade59be568e19c6cc70256b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0235e64-f82d-519d-b54a-09321410c47e/c0235e64-f82d-519d-b54a-09321410c47e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/2a/5d2a83e6669920814c58f0b7eed885e4/pa/UY15914_c8e2bea3a48acdbe383a7e469b221b98.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY15914%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Saving data for UY15914: {'created_time': 1774871437.491497, 'last_price_update_time': 1774871437.491509, 'auction_closing_time': 1774971950.0}
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY15914') HTTP/1.1" 204 0
2026-03-30 11:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:40 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM64227%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for HM64227: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for XN45926: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ73226%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for MJ73226: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for TF58036: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS35098%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for GS35098: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS14605%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for BS14605: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN20180%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for JN20180: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78085%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for XG78085: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX47829%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for VX47829: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK69232%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for GK69232: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ11174%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for FJ11174: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for SZ91004: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH88253%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for CH88253: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY37950%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for TY37950: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD13812%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for KD13812: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN92129%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for WN92129: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Scrape type for TX40265: 2
2026-03-30 11:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-30 11:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb74d561-fe35-51dc-afbc-3d7048a98f74 with scrape type 2
2026-03-30 11:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb74d561-fe35-51dc-afbc-3d7048a98f74 with scrape type 2
2026-03-30 11:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb74d561-fe35-51dc-afbc-3d7048a98f74, identifier: TX40265
2026-03-30 11:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-30 11:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-30 11:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265 to the API
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:40:14Z',
 'fuel_type': 'petrol',
 'id': 'fb74d561-fe35-51dc-afbc-3d7048a98f74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40265',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 203613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-20',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Saving data for TX40265: {'auction_closing_time': 1774885214.0, 'created_time': 1774643923.234122, 'last_price_update_time': 1774871441.551434}
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX40265') HTTP/1.1" 204 0
2026-03-30 11:50:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Scrape type for DT10357: 2
2026-03-30 11:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357
2026-03-30 11:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76512a1c-acc4-5a24-bbad-804d489016e6 with scrape type 2
2026-03-30 11:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76512a1c-acc4-5a24-bbad-804d489016e6 with scrape type 2
2026-03-30 11:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76512a1c-acc4-5a24-bbad-804d489016e6, identifier: DT10357
2026-03-30 11:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357
2026-03-30 11:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357
2026-03-30 11:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357 to the API
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:14:40Z',
 'fuel_type': 'petrol',
 'id': '76512a1c-acc4-5a24-bbad-804d489016e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT10357',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 168949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2014}
2026-03-30 11:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-30 11:50:42 [auto1.be] INFO: Saving data for DT10357: {'auction_closing_time': 1774883680.0, 'created_time': 1774265728.369825, 'last_price_update_time': 1774871442.042498}
2026-03-30 11:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT10357') HTTP/1.1" 204 0
2026-03-30 11:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:43 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for SW43031: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for KH45960: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for AM39981: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for BR08123: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for CY85383: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for WP77155: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for MK20841: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for RX06086: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for KT58942: 0
2026-03-30 11:50:43 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-30 11:50:43 [auto1.be] INFO: Scrape type for UY87343: 0
2026-03-30 11:50:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:52 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for MH83966: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for AD76625: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for HX23250: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for DH89229: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for UZ99297: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for DZ79289: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for ZY04103: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for EP64027: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for UR96395: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for PZ32696: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for SD10160: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for YA34487: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for RC41327: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for BL31735: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for PJ34917: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for TM16461: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for KD33371: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for ZM02853: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for ZP04877: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for BY53413: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for LY35485: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for KU68109: 0
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-30 11:50:52 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-30 11:50:52 [auto1.be] INFO: Scrape type for VL25326: 0
2026-03-30 11:50:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:53 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for RR05667: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for RA52713: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for XY08671: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for BY20726: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for KF56069: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for BV02466: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for SY52065: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for NG60197: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for YR77899: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for YU69949: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for UA36767: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for VE25219: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for WA86347: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for PS31946: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for KZ95632: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for ZP25114: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for FP22064: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-30 11:50:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:06 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for MX26890: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for ZX91910: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for LU53556: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for TT03576: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for BD95571: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for TC19196: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for CM14446: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for VE29498: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for AM49333: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for FC05247: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for NC38410: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for TX69988: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for HK94342: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for SL05027: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for EK47235: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for SJ26894: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for VP06293: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for DH17925: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for UX80051: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for MG99487: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for FG10633: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for KE27400: 0
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-30 11:51:06 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-30 11:51:06 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-30 11:51:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:06 [scrapy.extensions.logstats] INFO: Crawled 196 pages (at 8 pages/min), scraped 130 items (at 3 items/min)
2026-03-30 11:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ66091> (referer: https://www.auto1.com/v1/car-details-view/JZ66091/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28aa6aa7-9912-5a9c-b49f-054a1948e94b with identifier: JZ66091
2026-03-30 11:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b with scrape type 1
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_6a080872c0cdc40b2bf74700562ba77f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_6a080872c0cdc40b2bf74700562ba77f.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_58175edc161f01d58d96be0d8250b214.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_58175edc161f01d58d96be0d8250b214.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_4b006bbf3a1bd7bfac5facd3750be84a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_4b006bbf3a1bd7bfac5facd3750be84a.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_3c36468bb67d58915aa3ac2449581689.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_3c36468bb67d58915aa3ac2449581689.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_b550d781532430780406a81635a47bc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_b550d781532430780406a81635a47bc4.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_0fdf8fc579426c62b3eff6415b3c216b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0fdf8fc579426c62b3eff6415b3c216b.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_70fadf9d4477fc1b2aa6c4f7799ae600.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_70fadf9d4477fc1b2aa6c4f7799ae600.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_ebfa30ff6c568e96784db531ae1a8cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_ebfa30ff6c568e96784db531ae1a8cde.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_0766335c4a745e78e158c01182d42745.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0766335c4a745e78e158c01182d42745.jpg not downloaded yet
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_2639dd946fcab375bb5061d53724347f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_2639dd946fcab375bb5061d53724347f.jpg not downloaded yet
2026-03-30 11:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_58175edc161f01d58d96be0d8250b214.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_3c36468bb67d58915aa3ac2449581689.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_2639dd946fcab375bb5061d53724347f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0fdf8fc579426c62b3eff6415b3c216b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_4b006bbf3a1bd7bfac5facd3750be84a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_70fadf9d4477fc1b2aa6c4f7799ae600.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc975010>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_58175edc161f01d58d96be0d8250b214.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_58175edc161f01d58d96be0d8250b214.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_b550d781532430780406a81635a47bc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0766335c4a745e78e158c01182d42745.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_ebfa30ff6c568e96784db531ae1a8cde.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc6d92d0>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_3c36468bb67d58915aa3ac2449581689.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_3c36468bb67d58915aa3ac2449581689.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73deb0f310>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_2639dd946fcab375bb5061d53724347f.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_2639dd946fcab375bb5061d53724347f.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5c0e50>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_0fdf8fc579426c62b3eff6415b3c216b.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0fdf8fc579426c62b3eff6415b3c216b.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dca56b50>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_4b006bbf3a1bd7bfac5facd3750be84a.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_4b006bbf3a1bd7bfac5facd3750be84a.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73debd7990>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_70fadf9d4477fc1b2aa6c4f7799ae600.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_70fadf9d4477fc1b2aa6c4f7799ae600.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc902910>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_b550d781532430780406a81635a47bc4.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_b550d781532430780406a81635a47bc4.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5cdb50>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_0766335c4a745e78e158c01182d42745.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0766335c4a745e78e158c01182d42745.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc83d050>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_ebfa30ff6c568e96784db531ae1a8cde.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_ebfa30ff6c568e96784db531ae1a8cde.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_6a080872c0cdc40b2bf74700562ba77f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:51:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:51:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:51:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:51:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:51:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f73dc5ce150>
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F5d%252F265d7f6f5c7384dbc993c4b18081ae87%252Fpa%252FJZ66091_6a080872c0cdc40b2bf74700562ba77f.jpg') HTTP/1.1" 204 0
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_6a080872c0cdc40b2bf74700562ba77f.jpg saved to cache
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b
2026-03-30 11:51:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28aa6aa7-9912-5a9c-b49f-054a1948e94b, skipping ID generation
2026-03-30 11:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b with scrape type 1
2026-03-30 11:51:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28aa6aa7-9912-5a9c-b49f-054a1948e94b sending to next pipeline
2026-03-30 11:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 28aa6aa7-9912-5a9c-b49f-054a1948e94b, identifier: JZ66091
2026-03-30 11:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 28aa6aa7-9912-5a9c-b49f-054a1948e94b with identifier: JZ66091
2026-03-30 11:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 28aa6aa7-9912-5a9c-b49f-054a1948e94b with identifier: JZ66091
2026-03-30 11:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 28aa6aa7-9912-5a9c-b49f-054a1948e94b with identifier: JZ66091 to the API
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_6a080872c0cdc40b2bf74700562ba77f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:44:24Z',
 'fuel_type': 'petrol',
 'id': '28aa6aa7-9912-5a9c-b49f-054a1948e94b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ66091',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 108679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4280381,
             'Height': 4284,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_6a080872c0cdc40b2bf74700562ba77f.jpg',
             'Width': 5712},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_58175edc161f01d58d96be0d8250b214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_4b006bbf3a1bd7bfac5facd3750be84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_3c36468bb67d58915aa3ac2449581689.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_b550d781532430780406a81635a47bc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0fdf8fc579426c62b3eff6415b3c216b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_70fadf9d4477fc1b2aa6c4f7799ae600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_ebfa30ff6c568e96784db531ae1a8cde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_0766335c4a745e78e158c01182d42745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28aa6aa7-9912-5a9c-b49f-054a1948e94b/28aa6aa7-9912-5a9c-b49f-054a1948e94b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/5d/265d7f6f5c7384dbc993c4b18081ae87/pa/JZ66091_2639dd946fcab375bb5061d53724347f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Edition One',
 'transmission': 'manual',
 'trim': 'Edition One',
 'year': 2019}
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ66091%27 HTTP/1.1" 200 None
2026-03-30 11:51:13 [auto1.be] INFO: Saving data for JZ66091: {'created_time': 1774871473.53433, 'last_price_update_time': 1774871473.534339, 'auction_closing_time': 1774971864.0}
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ66091') HTTP/1.1" 204 0
2026-03-30 11:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:19 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for YU22338: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for SW98803: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for LP50838: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for MW29844: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for NP55006: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for DP40243: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for BR63185: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for AK19302: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for NR82041: 0
2026-03-30 11:51:19 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-30 11:51:19 [auto1.be] INFO: Scrape type for HU84368: 2
2026-03-30 11:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-30 11:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeb4fb4-43c5-5997-ba2e-31e160077d13 with scrape type 2
2026-03-30 11:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeb4fb4-43c5-5997-ba2e-31e160077d13 with scrape type 2
2026-03-30 11:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeb4fb4-43c5-5997-ba2e-31e160077d13, identifier: HU84368
2026-03-30 11:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-30 11:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-30 11:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368 to the API
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:48:53Z',
 'fuel_type': 'diesel',
 'id': 'deeb4fb4-43c5-5997-ba2e-31e160077d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU84368',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 212275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-30 11:51:20 [auto1.be] INFO: Saving data for HU84368: {'auction_closing_time': 1774885733.0, 'created_time': 1773780127.010949, 'last_price_update_time': 1774871480.080548}
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU84368') HTTP/1.1" 204 0
2026-03-30 11:51:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-30 11:51:20 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-30 11:51:20 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-30 11:51:20 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-30 11:51:20 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-30 11:51:20 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-30 11:51:20 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-30 11:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:40 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-30 11:51:40 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-30 11:51:40 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-30 11:51:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:41 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.be] INFO: Scrape type for ZL62218: 0
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-30 11:51:41 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-30 11:51:41 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-30 11:51:42 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-30 11:51:42 [auto1.be] INFO: Scrape type for RR43173: 2
2026-03-30 11:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-30 11:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a93e4f-b357-532f-98e7-382c259ae859 with scrape type 2
2026-03-30 11:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a93e4f-b357-532f-98e7-382c259ae859 with scrape type 2
2026-03-30 11:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51a93e4f-b357-532f-98e7-382c259ae859, identifier: RR43173
2026-03-30 11:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-30 11:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-30 11:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173 to the API
2026-03-30 11:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:52:12Z',
 'fuel_type': 'diesel',
 'id': '51a93e4f-b357-532f-98e7-382c259ae859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR43173',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 106717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.be] INFO: Saving data for RR43173: {'auction_closing_time': 1774885932.0, 'created_time': 1774600548.054374, 'last_price_update_time': 1774871503.164956}
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR43173') HTTP/1.1" 204 0
2026-03-30 11:51:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-30 11:51:43 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-30 11:51:43 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-30 11:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:44 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-30 11:51:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:45 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for WP32655: 2
2026-03-30 11:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-30 11:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e8f1a5-06f7-5510-bb0c-82171044cc06 with scrape type 2
2026-03-30 11:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43e8f1a5-06f7-5510-bb0c-82171044cc06 with scrape type 2
2026-03-30 11:51:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43e8f1a5-06f7-5510-bb0c-82171044cc06, identifier: WP32655
2026-03-30 11:51:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-30 11:51:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-30 11:51:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655 to the API
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'diesel',
 'id': '43e8f1a5-06f7-5510-bb0c-82171044cc06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP32655',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 57693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-19',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2014}
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Saving data for WP32655: {'auction_closing_time': 1774883032.0, 'created_time': 1774600540.963012, 'last_price_update_time': 1774871506.299991}
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP32655') HTTP/1.1" 204 0
2026-03-30 11:51:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-30 11:51:46 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-30 11:51:46 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-30 11:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:50 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for VD09174: 2
2026-03-30 11:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-30 11:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with scrape type 2
2026-03-30 11:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with scrape type 2
2026-03-30 11:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee, identifier: VD09174
2026-03-30 11:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-30 11:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-30 11:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174 to the API
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:30:50Z',
 'fuel_type': 'diesel',
 'id': 'c4308cbe-e410-57b1-8fd1-a7cfd3e170ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD09174',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 185116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-30 11:51:51 [auto1.be] INFO: Saving data for VD09174: {'auction_closing_time': 1774884650.0, 'created_time': 1773434380.758849, 'last_price_update_time': 1774871511.860253}
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VD09174') HTTP/1.1" 204 0
2026-03-30 11:51:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:51 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-30 11:51:51 [auto1.be] INFO: Scrape type for FY33898: 2
2026-03-30 11:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-30 11:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with scrape type 2
2026-03-30 11:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10, identifier: FY33898
2026-03-30 11:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-30 11:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-30 11:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898 to the API
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:23:48Z',
 'fuel_type': 'petrol',
 'id': '0176d99f-9376-5e1c-ab01-6f3e5fd48f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY33898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 291418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-17',
 'seller_name': None,
 'title': 'Audi TT 1.8 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2012}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Saving data for FY33898: {'auction_closing_time': 1774884228.0, 'created_time': 1773434461.814355, 'last_price_update_time': 1774871512.38348}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY33898') HTTP/1.1" 204 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-30 11:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:55 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for RA68631: 2
2026-03-30 11:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-30 11:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1708629c-498c-58cd-8397-84b9e29651f3 with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1708629c-498c-58cd-8397-84b9e29651f3 with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1708629c-498c-58cd-8397-84b9e29651f3, identifier: RA68631
2026-03-30 11:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-30 11:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-30 11:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631 to the API
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:17Z',
 'fuel_type': 'diesel',
 'id': '1708629c-498c-58cd-8397-84b9e29651f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA68631',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 228568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-19',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2017}
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Saving data for RA68631: {'auction_closing_time': 1774883117.0, 'created_time': 1774600542.551652, 'last_price_update_time': 1774871516.096761}
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA68631') HTTP/1.1" 204 0
2026-03-30 11:51:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-30 11:51:56 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-30 11:51:56 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-30 11:52:06 [scrapy.extensions.logstats] INFO: Crawled 204 pages (at 8 pages/min), scraped 137 items (at 7 items/min)
2026-03-30 11:52:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:13 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1767 | hits on page: 40
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-30 11:52:13 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Scrape type for EG14798: 2
2026-03-30 11:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-30 11:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e822f5b3-2786-56fc-90e7-1311ff739363 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e822f5b3-2786-56fc-90e7-1311ff739363 with scrape type 2
2026-03-30 11:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e822f5b3-2786-56fc-90e7-1311ff739363, identifier: EG14798
2026-03-30 11:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-30 11:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-30 11:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798 to the API
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:19:35Z',
 'fuel_type': 'petrol',
 'id': 'e822f5b3-2786-56fc-90e7-1311ff739363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG14798',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 137200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-30 11:52:13 [auto1.be] INFO: Saving data for EG14798: {'auction_closing_time': 1774883975.0, 'created_time': 1773909356.78368, 'last_price_update_time': 1774871533.962135}
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EG14798') HTTP/1.1" 204 0
2026-03-30 11:52:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-30 11:52:14 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-30 11:52:14 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-30 11:52:14 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-30 11:52:14 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-30 11:52:14 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-30 11:52:14 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-30 11:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:16 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1767 | hits on page: 40
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for NP75657: 2
2026-03-30 11:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-30 11:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with scrape type 2
2026-03-30 11:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with scrape type 2
2026-03-30 11:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a, identifier: NP75657
2026-03-30 11:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-30 11:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-30 11:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657 to the API
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:50:58Z',
 'fuel_type': 'petrol',
 'id': '285d0ff0-8be5-5929-9cce-b8c00c37ef2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP75657',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 149094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-25',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2011}
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Saving data for NP75657: {'auction_closing_time': 1774885858.0, 'created_time': 1774600543.772611, 'last_price_update_time': 1774871536.689472}
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP75657') HTTP/1.1" 204 0
2026-03-30 11:52:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-30 11:52:16 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-30 11:52:16 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-30 11:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-30 11:52:17 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-30 11:52:17 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-30 11:52:17 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-30 11:52:17 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-30 11:52:17 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-30 11:52:17 [auto1.be] INFO: Scrape type for NS97708: 2
2026-03-30 11:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-30 11:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817f1743-ff77-5064-a9cd-4dc974ab4f4b with scrape type 2
2026-03-30 11:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817f1743-ff77-5064-a9cd-4dc974ab4f4b with scrape type 2
2026-03-30 11:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 817f1743-ff77-5064-a9cd-4dc974ab4f4b, identifier: NS97708
2026-03-30 11:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-30 11:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-30 11:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708 to the API
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:03Z',
 'fuel_type': 'petrol',
 'id': '817f1743-ff77-5064-a9cd-4dc974ab4f4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS97708',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-26',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Night and Day',
 'transmission': 'manual',
 'trim': 'Night and Day',
 'year': 2010}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Saving data for NS97708: {'auction_closing_time': 1774884903.0, 'created_time': 1774514158.29556, 'last_price_update_time': 1774871538.105006}
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS97708') HTTP/1.1" 204 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-30 11:52:18 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-30 11:52:18 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-30 11:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:19 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1767 | hits on page: 40
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-30 11:52:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:22 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1767 | hits on page: 40
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for JB98140: 2
2026-03-30 11:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-30 11:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with scrape type 2
2026-03-30 11:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with scrape type 2
2026-03-30 11:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb, identifier: JB98140
2026-03-30 11:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-30 11:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-30 11:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140 to the API
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:35Z',
 'fuel_type': 'diesel',
 'id': 'fd04258e-0d92-5c3d-8721-e65c6bd9d3bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB98140',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 318252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-23',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2013}
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Saving data for JB98140: {'auction_closing_time': 1774885535.0, 'created_time': 1774600539.62481, 'last_price_update_time': 1774871542.700911}
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB98140') HTTP/1.1" 204 0
2026-03-30 11:52:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-30 11:52:22 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-30 11:52:22 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for SF89359: 2
2026-03-30 11:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-30 11:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90467edd-a787-5155-96c7-48be11c31ff2 with scrape type 2
2026-03-30 11:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90467edd-a787-5155-96c7-48be11c31ff2 with scrape type 2
2026-03-30 11:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90467edd-a787-5155-96c7-48be11c31ff2, identifier: SF89359
2026-03-30 11:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-30 11:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-30 11:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359 to the API
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'petrol',
 'id': '90467edd-a787-5155-96c7-48be11c31ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF89359',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 80555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Saving data for SF89359: {'auction_closing_time': 1774883227.0, 'created_time': 1774600538.33691, 'last_price_update_time': 1774871543.656791}
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SF89359') HTTP/1.1" 204 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-30 11:52:23 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-30 11:52:23 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-30 11:52:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:26 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1768 | hits on page: 40
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-30 11:52:26 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-30 11:52:26 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-30 11:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for MA69424: 2
2026-03-30 11:52:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-30 11:52:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with scrape type 2
2026-03-30 11:52:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with scrape type 2
2026-03-30 11:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812, identifier: MA69424
2026-03-30 11:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-30 11:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-30 11:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424 to the API
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:31:09Z',
 'fuel_type': 'diesel',
 'id': '55dc8aba-cf4d-5ca8-a65e-fa42572d3812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA69424',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 144248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Saving data for MA69424: {'auction_closing_time': 1774884669.0, 'created_time': 1773132633.832627, 'last_price_update_time': 1774871547.523132}
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA69424') HTTP/1.1" 204 0
2026-03-30 11:52:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for UC56570: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-30 11:52:27 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-30 11:52:27 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-30 11:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:32 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1768 | hits on page: 40
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for HF54985: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-30 11:52:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:36 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1769 | hits on page: 40
2026-03-30 11:52:36 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-30 11:52:36 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-30 11:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-30 11:52:36 [auto1.be] INFO: Scrape type for BJ55526: 2
2026-03-30 11:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-30 11:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with scrape type 2
2026-03-30 11:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with scrape type 2
2026-03-30 11:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4412c6c3-53c2-56cf-9d30-c3800dda54e9, identifier: BJ55526
2026-03-30 11:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-30 11:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-30 11:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526 to the API
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:57:29Z',
 'fuel_type': 'petrol',
 'id': '4412c6c3-53c2-56cf-9d30-c3800dda54e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ55526',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 176548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Basis +',
 'transmission': 'manual',
 'trim': 'Basis +',
 'year': 2012}
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Saving data for BJ55526: {'auction_closing_time': 1774886249.0, 'created_time': 1774600525.857736, 'last_price_update_time': 1774871557.222219}
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ55526') HTTP/1.1" 204 0
2026-03-30 11:52:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for NR94896: 2
2026-03-30 11:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-30 11:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446467ba-2c5c-5540-92d6-0f9df88e4d8f with scrape type 2
2026-03-30 11:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446467ba-2c5c-5540-92d6-0f9df88e4d8f with scrape type 2
2026-03-30 11:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 446467ba-2c5c-5540-92d6-0f9df88e4d8f, identifier: NR94896
2026-03-30 11:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-30 11:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-30 11:52:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896 to the API
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'diesel',
 'id': '446467ba-2c5c-5540-92d6-0f9df88e4d8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR94896',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 136162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue 4x2 Titanium',
 'transmission': 'automatic',
 'trim': '4x2 Titanium',
 'year': 2020}
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-30 11:52:38 [auto1.be] INFO: Saving data for NR94896: {'auction_closing_time': 1774885237.0, 'created_time': 1774600544.249187, 'last_price_update_time': 1774871558.042435}
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NR94896') HTTP/1.1" 204 0
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-30 11:52:38 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-30 11:52:38 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-30 11:52:38 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-30 11:52:38 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-30 11:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:39 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1769 | hits on page: 40
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for VA59143: 2
2026-03-30 11:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-30 11:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f2d533-e0ae-5885-9736-b45258329035 with scrape type 2
2026-03-30 11:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f2d533-e0ae-5885-9736-b45258329035 with scrape type 2
2026-03-30 11:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54f2d533-e0ae-5885-9736-b45258329035, identifier: VA59143
2026-03-30 11:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-30 11:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-30 11:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143 to the API
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:42:38Z',
 'fuel_type': 'diesel',
 'id': '54f2d533-e0ae-5885-9736-b45258329035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA59143',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 206974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 1.6 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-30 11:52:40 [auto1.be] INFO: Saving data for VA59143: {'auction_closing_time': 1774885358.0, 'created_time': 1773780033.301243, 'last_price_update_time': 1774871560.250013}
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA59143') HTTP/1.1" 204 0
2026-03-30 11:52:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:40 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-30 11:53:06 [scrapy.extensions.logstats] INFO: Crawled 212 pages (at 8 pages/min), scraped 146 items (at 9 items/min)
2026-03-30 11:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:54:06 [scrapy.extensions.logstats] INFO: Crawled 212 pages (at 0 pages/min), scraped 146 items (at 0 items/min)
2026-03-30 11:54:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:54:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.387(s), this was the 1st time calling it.
2026-03-30 11:54:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.784520576017221 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:54:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:06 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1772 | hits on page: 40
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-30 11:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:06 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 1 pages/min), scraped 146 items (at 0 items/min)
2026-03-30 11:55:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:07 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1772 | hits on page: 40
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for NZ84501: 2
2026-03-30 11:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-30 11:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53177884-ab4c-50a6-853e-6e5964d8bc27 with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53177884-ab4c-50a6-853e-6e5964d8bc27 with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53177884-ab4c-50a6-853e-6e5964d8bc27, identifier: NZ84501
2026-03-30 11:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-30 11:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-30 11:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501 to the API
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:36Z',
 'fuel_type': 'petrol',
 'id': '53177884-ab4c-50a6-853e-6e5964d8bc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ84501',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 107943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-29',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Custom',
 'transmission': 'automatic',
 'trim': 'Custom',
 'year': 2016}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Saving data for NZ84501: {'auction_closing_time': 1774883076.0, 'created_time': 1774600542.14891, 'last_price_update_time': 1774871708.185489}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ84501') HTTP/1.1" 204 0
2026-03-30 11:55:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-30 11:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:24 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1773 | hits on page: 40
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-30 11:55:24 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-30 11:55:24 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for AT20959: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-30 11:55:25 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-30 11:55:25 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-30 11:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:26 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1774 | hits on page: 40
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-30 11:55:26 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-30 11:55:26 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-30 11:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:27 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1774 | hits on page: 40
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-30 11:55:27 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-30 11:55:27 [auto1.be] INFO: Scrape type for CX83686: 2
2026-03-30 11:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-30 11:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb3ceb2-6234-5922-a477-19e3436c2264 with scrape type 2
2026-03-30 11:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb3ceb2-6234-5922-a477-19e3436c2264 with scrape type 2
2026-03-30 11:55:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bb3ceb2-6234-5922-a477-19e3436c2264, identifier: CX83686
2026-03-30 11:55:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-30 11:55:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-30 11:55:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686 to the API
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:38:59Z',
 'fuel_type': 'hybrid',
 'id': '1bb3ceb2-6234-5922-a477-19e3436c2264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX83686',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 75365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Saving data for CX83686: {'auction_closing_time': 1774885139.0, 'created_time': 1773866727.396592, 'last_price_update_time': 1774871728.4239}
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX83686') HTTP/1.1" 204 0
2026-03-30 11:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for HU17820: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for NV75936: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-30 11:55:28 [auto1.be] INFO: Scrape type for AW25378: 0
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-30 11:55:28 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-30 11:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:36 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1774 | hits on page: 40
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for LS82290: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for CM51817: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for RD23593: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for GD95033: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for LG99308: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for KW17867: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for HS15781: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for HT80629: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for FT23017: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for MY75694: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for LH19076: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for FT86060: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for TF49476: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-30 11:55:36 [auto1.be] INFO: Scrape type for JT63704: 0
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-30 11:55:36 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-30 11:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-30 11:55:37 [auto1.be] INFO: Scrape type for SX16585: 0
2026-03-30 11:55:37 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-30 11:55:37 [auto1.be] INFO: Scrape type for TF43790: 0
2026-03-30 11:55:37 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-30 11:55:37 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-30 11:55:37 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-30 11:55:37 [auto1.be] INFO: Scrape type for LF44164: 0
2026-03-30 11:55:37 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-30 11:55:37 [auto1.be] INFO: Scrape type for SV00163: 0
2026-03-30 11:55:37 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-30 11:55:37 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-30 11:55:37 [auto1.be] INFO: Scrape type for VM07385: 0
2026-03-30 11:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:53 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1774 | hits on page: 40
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for WC19794: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for SB51494: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for KM81672: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for JC37428: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for BT48733: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for JM52918: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for PJ47204: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for WV93881: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for WV93759: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for HZ76034: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: US61524
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for US61524: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for WJ93890: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for DN00999: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for ZW40078: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-30 11:55:53 [auto1.be] INFO: Scrape type for YW96446: 0
2026-03-30 11:55:53 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-30 11:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:58 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1774 | hits on page: 40
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for UE64828: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for KF94293: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for LM13926: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for AE63964: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for SL57288: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for RK43455: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for FB93927: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for SV46049: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for WV65314: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for FM81572: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for MW50956: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for DN28044: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for WG38275: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for NC08569: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for CF30779: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for WT53046: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for DR48094: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for JZ34939: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for TX04561: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for BC33060: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for EP00364: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for HB59214: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for SX95001: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [auto1.be] INFO: Scrape type for UR33188: 0
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-30 11:55:58 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-30 11:55:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:06 [scrapy.extensions.logstats] INFO: Crawled 220 pages (at 7 pages/min), scraped 148 items (at 2 items/min)
2026-03-30 11:56:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:07 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1774 | hits on page: 40
2026-03-30 11:56:07 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-30 11:56:07 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-30 11:56:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for FJ57746: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for KZ05274: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for HK87235: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for CD22470: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for SJ05954: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for FV90992: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for PG48700: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for DC62563: 0
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for ZP95092: 2
2026-03-30 11:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-30 11:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a35d51-4951-5c9f-8818-3370273c76ff with scrape type 2
2026-03-30 11:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a35d51-4951-5c9f-8818-3370273c76ff with scrape type 2
2026-03-30 11:56:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29a35d51-4951-5c9f-8818-3370273c76ff, identifier: ZP95092
2026-03-30 11:56:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-30 11:56:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-30 11:56:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092 to the API
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:16:36Z',
 'fuel_type': 'diesel',
 'id': '29a35d51-4951-5c9f-8818-3370273c76ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP95092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 155775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Saving data for ZP95092: {'auction_closing_time': 1774883796.0, 'created_time': 1774697793.64774, 'last_price_update_time': 1774871768.848737}
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP95092') HTTP/1.1" 204 0
2026-03-30 11:56:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:08 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-30 11:56:08 [auto1.be] INFO: Scrape type for ZR35447: 2
2026-03-30 11:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-30 11:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db941a1-8645-5c6f-bbf7-fe200134479b with scrape type 2
2026-03-30 11:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db941a1-8645-5c6f-bbf7-fe200134479b with scrape type 2
2026-03-30 11:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6db941a1-8645-5c6f-bbf7-fe200134479b, identifier: ZR35447
2026-03-30 11:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-30 11:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-30 11:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447 to the API
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:10:19Z',
 'fuel_type': 'petrol',
 'id': '6db941a1-8645-5c6f-bbf7-fe200134479b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR35447',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 75287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-20',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-30 11:56:09 [auto1.be] INFO: Saving data for ZR35447: {'auction_closing_time': 1774883419.0, 'created_time': 1774697762.611259, 'last_price_update_time': 1774871769.349472}
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR35447') HTTP/1.1" 204 0
2026-03-30 11:56:09 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-30 11:56:09 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-30 11:56:09 [auto1.be] INFO: Scrape type for CA54828: 2
2026-03-30 11:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-30 11:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9659d86c-725d-5eda-90c3-5d685b1b8f6f with scrape type 2
2026-03-30 11:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9659d86c-725d-5eda-90c3-5d685b1b8f6f with scrape type 2
2026-03-30 11:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9659d86c-725d-5eda-90c3-5d685b1b8f6f, identifier: CA54828
2026-03-30 11:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-30 11:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-30 11:56:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828 to the API
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:24:26Z',
 'fuel_type': 'petrol',
 'id': '9659d86c-725d-5eda-90c3-5d685b1b8f6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA54828',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 78578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-06',
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-30 11:56:09 [auto1.be] INFO: Saving data for CA54828: {'auction_closing_time': 1774884266.0, 'created_time': 1774697722.446956, 'last_price_update_time': 1774871769.720216}
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA54828') HTTP/1.1" 204 0
2026-03-30 11:56:09 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-30 11:56:09 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-30 11:56:09 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-30 11:56:09 [auto1.be] INFO: Scrape type for FW70524: 2
2026-03-30 11:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-30 11:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with scrape type 2
2026-03-30 11:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with scrape type 2
2026-03-30 11:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9, identifier: FW70524
2026-03-30 11:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-30 11:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-30 11:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524 to the API
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'diesel',
 'id': '2e352c4e-7a8e-506f-8bfb-ccdde942a5e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW70524',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 282602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-22',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.be] INFO: Saving data for FW70524: {'auction_closing_time': 1774885654.0, 'created_time': 1774697754.743089, 'last_price_update_time': 1774871770.225672}
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW70524') HTTP/1.1" 204 0
2026-03-30 11:56:10 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-30 11:56:10 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-30 11:56:10 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-30 11:56:10 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.be] INFO: Scrape type for NZ74768: 2
2026-03-30 11:56:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-30 11:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82a8942-6e07-5172-a324-f6c919315007 with scrape type 2
2026-03-30 11:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82a8942-6e07-5172-a324-f6c919315007 with scrape type 2
2026-03-30 11:56:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f82a8942-6e07-5172-a324-f6c919315007, identifier: NZ74768
2026-03-30 11:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-30 11:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-30 11:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768 to the API
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:48Z',
 'fuel_type': 'diesel',
 'id': 'f82a8942-6e07-5172-a324-f6c919315007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ74768',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Navara NP-300',
 'odometer': 63531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-11',
 'seller_name': None,
 'title': 'Nissan Navara NP-300 2.3 dCi N-Guard Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'N-Guard Double Cab 4x4',
 'year': 2021}
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.be] INFO: Saving data for NZ74768: {'auction_closing_time': 1774884168.0, 'created_time': 1774697723.542976, 'last_price_update_time': 1774871770.612948}
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ74768') HTTP/1.1" 204 0
2026-03-30 11:56:10 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.be] INFO: Scrape type for AC55620: 2
2026-03-30 11:56:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-30 11:56:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3505842-9219-5595-bcdf-7e483fd8cc77 with scrape type 2
2026-03-30 11:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3505842-9219-5595-bcdf-7e483fd8cc77 with scrape type 2
2026-03-30 11:56:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3505842-9219-5595-bcdf-7e483fd8cc77, identifier: AC55620
2026-03-30 11:56:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-30 11:56:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-30 11:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620 to the API
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:32Z',
 'fuel_type': 'diesel',
 'id': 'd3505842-9219-5595-bcdf-7e483fd8cc77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC55620',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.be] INFO: Saving data for AC55620: {'auction_closing_time': 1774883852.0, 'created_time': 1774697759.100817, 'last_price_update_time': 1774871770.986943}
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AC55620') HTTP/1.1" 204 0
2026-03-30 11:56:11 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-30 11:56:11 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-30 11:56:11 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.be] INFO: Scrape type for YZ92764: 2
2026-03-30 11:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-30 11:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with scrape type 2
2026-03-30 11:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with scrape type 2
2026-03-30 11:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73, identifier: YZ92764
2026-03-30 11:56:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 11:56:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-30 11:56:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764 to the API
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:08Z',
 'fuel_type': 'diesel',
 'id': 'fa75fb00-33d1-5d0b-89b1-6d1bb5575d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ92764',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'iQ',
 'odometer': 214536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-01',
 'seller_name': None,
 'title': 'Toyota iQ 1.4 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.be] INFO: Saving data for YZ92764: {'auction_closing_time': 1774885448.0, 'created_time': 1774697756.107384, 'last_price_update_time': 1774871771.627158}
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ92764') HTTP/1.1" 204 0
2026-03-30 11:56:11 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-30 11:56:11 [auto1.be] INFO: Scrape type for ZZ63767: 2
2026-03-30 11:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-30 11:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94004ea2-ab18-5923-acab-dee180fd7603 with scrape type 2
2026-03-30 11:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94004ea2-ab18-5923-acab-dee180fd7603 with scrape type 2
2026-03-30 11:56:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94004ea2-ab18-5923-acab-dee180fd7603, identifier: ZZ63767
2026-03-30 11:56:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-30 11:56:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-30 11:56:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767 to the API
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:16:26Z',
 'fuel_type': 'diesel',
 'id': '94004ea2-ab18-5923-acab-dee180fd7603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ63767',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 210839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-28',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.9 DI-D Family 1900',
 'transmission': 'manual',
 'trim': 'Family 1900',
 'year': 2004}
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-30 11:56:12 [auto1.be] INFO: Saving data for ZZ63767: {'auction_closing_time': 1774883786.0, 'created_time': 1774697723.967728, 'last_price_update_time': 1774871772.022975}
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ63767') HTTP/1.1" 204 0
2026-03-30 11:56:12 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-30 11:56:12 [auto1.be] INFO: Scrape type for VW23905: 2
2026-03-30 11:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-30 11:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f76f7f9d-b84f-598c-952c-b8892a754a78 with scrape type 2
2026-03-30 11:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f76f7f9d-b84f-598c-952c-b8892a754a78 with scrape type 2
2026-03-30 11:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f76f7f9d-b84f-598c-952c-b8892a754a78, identifier: VW23905
2026-03-30 11:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-30 11:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-30 11:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905 to the API
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:51:57Z',
 'fuel_type': 'diesel',
 'id': 'f76f7f9d-b84f-598c-952c-b8892a754a78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW23905',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 88076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-30 11:56:12 [auto1.be] INFO: Saving data for VW23905: {'auction_closing_time': 1774885917.0, 'created_time': 1774697794.950548, 'last_price_update_time': 1774871772.511695}
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW23905') HTTP/1.1" 204 0
2026-03-30 11:56:12 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-30 11:56:12 [auto1.be] INFO: Scrape type for BZ70123: 2
2026-03-30 11:56:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-30 11:56:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e86c8e1-36cc-5df4-8c16-d258792dff96 with scrape type 2
2026-03-30 11:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e86c8e1-36cc-5df4-8c16-d258792dff96 with scrape type 2
2026-03-30 11:56:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e86c8e1-36cc-5df4-8c16-d258792dff96, identifier: BZ70123
2026-03-30 11:56:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-30 11:56:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-30 11:56:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123 to the API
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:20:38Z',
 'fuel_type': 'diesel',
 'id': '4e86c8e1-36cc-5df4-8c16-d258792dff96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ70123',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 150432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-15',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2015}
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-30 11:56:12 [auto1.be] INFO: Saving data for BZ70123: {'auction_closing_time': 1774884038.0, 'created_time': 1773384489.030312, 'last_price_update_time': 1774871772.923557}
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ70123') HTTP/1.1" 204 0
2026-03-30 11:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:18 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1774 | hits on page: 40
2026-03-30 11:56:18 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-30 11:56:18 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-30 11:56:18 [auto1.be] INFO: Scrape type for XC95069: 2
2026-03-30 11:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-30 11:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2d479b-7554-5303-94e6-76865bc86c59 with scrape type 2
2026-03-30 11:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb2d479b-7554-5303-94e6-76865bc86c59 with scrape type 2
2026-03-30 11:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb2d479b-7554-5303-94e6-76865bc86c59, identifier: XC95069
2026-03-30 11:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-30 11:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-30 11:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069 to the API
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:45:50Z',
 'fuel_type': 'petrol',
 'id': 'bb2d479b-7554-5303-94e6-76865bc86c59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC95069',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 109962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-30 11:56:18 [auto1.be] INFO: Saving data for XC95069: {'auction_closing_time': 1774885550.0, 'created_time': 1774697752.335925, 'last_price_update_time': 1774871778.387085}
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC95069') HTTP/1.1" 204 0
2026-03-30 11:56:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:18 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-30 11:56:18 [auto1.be] INFO: Scrape type for BS70441: 2
2026-03-30 11:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-30 11:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e433a844-a689-5367-8714-653fee095003 with scrape type 2
2026-03-30 11:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e433a844-a689-5367-8714-653fee095003 with scrape type 2
2026-03-30 11:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e433a844-a689-5367-8714-653fee095003, identifier: BS70441
2026-03-30 11:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-30 11:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-30 11:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441 to the API
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:35:56Z',
 'fuel_type': 'petrol',
 'id': 'e433a844-a689-5367-8714-653fee095003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS70441',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 123064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 140 L Classic',
 'transmission': 'automatic',
 'trim': 'L Classic',
 'year': 2004}
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-30 11:56:18 [auto1.be] INFO: Saving data for BS70441: {'auction_closing_time': 1774884956.0, 'created_time': 1774697755.103194, 'last_price_update_time': 1774871778.756428}
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BS70441') HTTP/1.1" 204 0
2026-03-30 11:56:18 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-30 11:56:18 [auto1.be] INFO: Scrape type for GM14941: 2
2026-03-30 11:56:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-30 11:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a with scrape type 2
2026-03-30 11:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a with scrape type 2
2026-03-30 11:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e7864f8-93d6-521c-8d1b-1354badf6d8a, identifier: GM14941
2026-03-30 11:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-30 11:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-30 11:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941 to the API
2026-03-30 11:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'petrol',
 'id': '6e7864f8-93d6-521c-8d1b-1354badf6d8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM14941',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 16541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-30 11:56:19 [auto1.be] INFO: Saving data for GM14941: {'auction_closing_time': 1774884663.0, 'created_time': 1774697751.947689, 'last_price_update_time': 1774871779.155666}
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM14941') HTTP/1.1" 204 0
2026-03-30 11:56:19 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-30 11:56:19 [auto1.be] INFO: Scrape type for SY87797: 2
2026-03-30 11:56:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-30 11:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e46d3f0-0807-5b96-8849-00972b4d6143 with scrape type 2
2026-03-30 11:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e46d3f0-0807-5b96-8849-00972b4d6143 with scrape type 2
2026-03-30 11:56:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e46d3f0-0807-5b96-8849-00972b4d6143, identifier: SY87797
2026-03-30 11:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-30 11:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-30 11:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797 to the API
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:48Z',
 'fuel_type': 'petrol',
 'id': '6e46d3f0-0807-5b96-8849-00972b4d6143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY87797',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 165349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-25',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-30 11:56:19 [auto1.be] INFO: Saving data for SY87797: {'auction_closing_time': 1774885368.0, 'created_time': 1774697749.821526, 'last_price_update_time': 1774871779.596226}
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY87797') HTTP/1.1" 204 0
2026-03-30 11:56:19 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-30 11:56:19 [auto1.be] INFO: Scrape type for WV78161: 2
2026-03-30 11:56:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-30 11:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with scrape type 2
2026-03-30 11:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with scrape type 2
2026-03-30 11:56:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c, identifier: WV78161
2026-03-30 11:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-30 11:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-30 11:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161 to the API
2026-03-30 11:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:18:35Z',
 'fuel_type': 'diesel',
 'id': 'c86d0a7d-14b3-5db9-af01-0c5152bd3d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV78161',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 41439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-12',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
 'transmission': 'manual',
 'trim': 'Rapid Maxi Extra',
 'year': 2020}
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.be] INFO: Saving data for WV78161: {'auction_closing_time': 1774883915.0, 'created_time': 1773384681.527128, 'last_price_update_time': 1774871780.116297}
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV78161') HTTP/1.1" 204 0
2026-03-30 11:56:20 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.be] INFO: Scrape type for ZV95387: 2
2026-03-30 11:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-30 11:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0881ec-6709-5d81-81b2-5054e324342b with scrape type 2
2026-03-30 11:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0881ec-6709-5d81-81b2-5054e324342b with scrape type 2
2026-03-30 11:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b0881ec-6709-5d81-81b2-5054e324342b, identifier: ZV95387
2026-03-30 11:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-30 11:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-30 11:56:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387 to the API
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:59Z',
 'fuel_type': 'petrol',
 'id': '3b0881ec-6709-5d81-81b2-5054e324342b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV95387',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 84058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.be] INFO: Saving data for ZV95387: {'auction_closing_time': 1774885379.0, 'created_time': 1774697801.794006, 'last_price_update_time': 1774871780.513015}
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZV95387') HTTP/1.1" 204 0
2026-03-30 11:56:20 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-30 11:56:20 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.be] INFO: Scrape type for KB40459: 2
2026-03-30 11:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-30 11:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d42316a-0279-56f7-9b8e-5699d25c82b6 with scrape type 2
2026-03-30 11:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d42316a-0279-56f7-9b8e-5699d25c82b6 with scrape type 2
2026-03-30 11:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d42316a-0279-56f7-9b8e-5699d25c82b6, identifier: KB40459
2026-03-30 11:56:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-30 11:56:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-30 11:56:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459 to the API
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:44Z',
 'fuel_type': 'petrol',
 'id': '6d42316a-0279-56f7-9b8e-5699d25c82b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB40459',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 129413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.be] INFO: Saving data for KB40459: {'auction_closing_time': 1774885904.0, 'created_time': 1774697748.969292, 'last_price_update_time': 1774871780.907392}
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KB40459') HTTP/1.1" 204 0
2026-03-30 11:56:20 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-30 11:56:20 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-30 11:56:20 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.be] INFO: Scrape type for ZZ39097: 2
2026-03-30 11:56:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-30 11:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1eee54d-5421-5ab8-8769-bd0fe8b84449 with scrape type 2
2026-03-30 11:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1eee54d-5421-5ab8-8769-bd0fe8b84449 with scrape type 2
2026-03-30 11:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1eee54d-5421-5ab8-8769-bd0fe8b84449, identifier: ZZ39097
2026-03-30 11:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-30 11:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-30 11:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097 to the API
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:10Z',
 'fuel_type': 'diesel',
 'id': 'a1eee54d-5421-5ab8-8769-bd0fe8b84449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ39097',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 126244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-21',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-30 11:56:21 [auto1.be] INFO: Saving data for ZZ39097: {'auction_closing_time': 1774885450.0, 'created_time': 1774697803.877391, 'last_price_update_time': 1774871781.303314}
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ39097') HTTP/1.1" 204 0
2026-03-30 11:56:21 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-30 11:56:21 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-30 11:56:21 [auto1.be] INFO: Scrape type for SC10935: 2
2026-03-30 11:56:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-30 11:56:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a11eda-652d-5f8e-80e7-402930d101e3 with scrape type 2
2026-03-30 11:56:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42a11eda-652d-5f8e-80e7-402930d101e3 with scrape type 2
2026-03-30 11:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42a11eda-652d-5f8e-80e7-402930d101e3, identifier: SC10935
2026-03-30 11:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-30 11:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-30 11:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935 to the API
2026-03-30 11:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:58Z',
 'fuel_type': 'diesel',
 'id': '42a11eda-652d-5f8e-80e7-402930d101e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC10935',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 225479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 CDTI DPF Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2015}
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.be] INFO: Saving data for SC10935: {'auction_closing_time': 1774883218.0, 'created_time': 1774697802.498061, 'last_price_update_time': 1774871782.401508}
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC10935') HTTP/1.1" 204 0
2026-03-30 11:56:22 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.be] INFO: Scrape type for BU18930: 2
2026-03-30 11:56:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-30 11:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41becf54-0430-5c07-8557-5a3865934ccf with scrape type 2
2026-03-30 11:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41becf54-0430-5c07-8557-5a3865934ccf with scrape type 2
2026-03-30 11:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41becf54-0430-5c07-8557-5a3865934ccf, identifier: BU18930
2026-03-30 11:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-30 11:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-30 11:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930 to the API
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:01Z',
 'fuel_type': 'diesel',
 'id': '41becf54-0430-5c07-8557-5a3865934ccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU18930',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 275170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.be] INFO: Saving data for BU18930: {'auction_closing_time': 1774883941.0, 'created_time': 1774697753.745961, 'last_price_update_time': 1774871782.800282}
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU18930') HTTP/1.1" 204 0
2026-03-30 11:56:22 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-30 11:56:22 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-30 11:56:22 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-30 11:56:22 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-30 11:56:22 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.be] INFO: Scrape type for CN37182: 2
2026-03-30 11:56:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-30 11:56:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7d568-2372-53d1-9a2a-801a755fb75c with scrape type 2
2026-03-30 11:56:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ee7d568-2372-53d1-9a2a-801a755fb75c with scrape type 2
2026-03-30 11:56:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ee7d568-2372-53d1-9a2a-801a755fb75c, identifier: CN37182
2026-03-30 11:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-30 11:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-30 11:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182 to the API
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:32:54Z',
 'fuel_type': 'diesel',
 'id': '7ee7d568-2372-53d1-9a2a-801a755fb75c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN37182',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 60189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L2H1 2,9t Formula Edition',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Formula Edition',
 'year': 2017}
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-30 11:56:23 [auto1.be] INFO: Saving data for CN37182: {'auction_closing_time': 1774884774.0, 'created_time': 1774697732.981308, 'last_price_update_time': 1774871783.23965}
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN37182') HTTP/1.1" 204 0
2026-03-30 11:56:23 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-30 11:56:23 [auto1.be] INFO: Scrape type for EK79460: 2
2026-03-30 11:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-30 11:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c69946-e6f2-5427-8592-657055574d32 with scrape type 2
2026-03-30 11:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c69946-e6f2-5427-8592-657055574d32 with scrape type 2
2026-03-30 11:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9c69946-e6f2-5427-8592-657055574d32, identifier: EK79460
2026-03-30 11:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-30 11:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-30 11:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460 to the API
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:02Z',
 'fuel_type': 'diesel',
 'id': 'f9c69946-e6f2-5427-8592-657055574d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK79460',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 122467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-21',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-30 11:56:23 [auto1.be] INFO: Saving data for EK79460: {'auction_closing_time': 1774884122.0, 'created_time': 1773909357.314713, 'last_price_update_time': 1774871783.745333}
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK79460') HTTP/1.1" 204 0
2026-03-30 11:56:23 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-30 11:56:23 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-30 11:56:23 [auto1.be] INFO: Scrape type for KE51169: 2
2026-03-30 11:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-30 11:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6952caac-088e-5006-9a46-9b48f1abe497 with scrape type 2
2026-03-30 11:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6952caac-088e-5006-9a46-9b48f1abe497 with scrape type 2
2026-03-30 11:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6952caac-088e-5006-9a46-9b48f1abe497, identifier: KE51169
2026-03-30 11:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-30 11:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-30 11:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169 to the API
2026-03-30 11:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:07Z',
 'fuel_type': 'diesel',
 'id': '6952caac-088e-5006-9a46-9b48f1abe497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE51169',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 130823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-16',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2010}
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-30 11:56:24 [auto1.be] INFO: Saving data for KE51169: {'auction_closing_time': 1774885447.0, 'created_time': 1774697795.32819, 'last_price_update_time': 1774871784.159479}
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE51169') HTTP/1.1" 204 0
2026-03-30 11:56:24 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-30 11:56:24 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-30 11:56:24 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-30 11:56:24 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-30 11:56:24 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-30 11:56:24 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-30 11:56:24 [auto1.be] INFO: Scrape type for XS76018: 2
2026-03-30 11:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-30 11:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a00c4bcf-7f42-5950-b0cd-015cfad5186e with scrape type 2
2026-03-30 11:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a00c4bcf-7f42-5950-b0cd-015cfad5186e with scrape type 2
2026-03-30 11:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a00c4bcf-7f42-5950-b0cd-015cfad5186e, identifier: XS76018
2026-03-30 11:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-30 11:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-30 11:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018 to the API
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:29:22Z',
 'fuel_type': 'petrol',
 'id': 'a00c4bcf-7f42-5950-b0cd-015cfad5186e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS76018',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 38521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-30 11:56:24 [auto1.be] INFO: Saving data for XS76018: {'auction_closing_time': 1774884562.0, 'created_time': 1774697730.689196, 'last_price_update_time': 1774871784.575742}
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS76018') HTTP/1.1" 204 0
2026-03-30 11:56:24 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-30 11:56:24 [auto1.be] INFO: Scrape type for UY92003: 2
2026-03-30 11:56:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-30 11:56:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0371ffca-6417-5000-9cfe-c3e1707bd28b with scrape type 2
2026-03-30 11:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0371ffca-6417-5000-9cfe-c3e1707bd28b with scrape type 2
2026-03-30 11:56:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0371ffca-6417-5000-9cfe-c3e1707bd28b, identifier: UY92003
2026-03-30 11:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-30 11:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-30 11:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003 to the API
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:32Z',
 'fuel_type': 'petrol',
 'id': '0371ffca-6417-5000-9cfe-c3e1707bd28b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY92003',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Verso',
 'odometer': 106735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-01-31',
 'seller_name': None,
 'title': 'Toyota Yaris Verso 1.3 VVT-i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-30 11:56:24 [auto1.be] INFO: Saving data for UY92003: {'auction_closing_time': 1774886312.0, 'created_time': 1774697791.974794, 'last_price_update_time': 1774871784.982109}
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY92003') HTTP/1.1" 204 0
2026-03-30 11:56:25 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-30 11:56:25 [auto1.be] INFO: Scrape type for NV64774: 2
2026-03-30 11:56:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-30 11:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb386063-39c7-587d-ad9a-ff6800bae828 with scrape type 2
2026-03-30 11:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb386063-39c7-587d-ad9a-ff6800bae828 with scrape type 2
2026-03-30 11:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb386063-39c7-587d-ad9a-ff6800bae828, identifier: NV64774
2026-03-30 11:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-30 11:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-30 11:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774 to the API
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:35:10Z',
 'fuel_type': 'petrol',
 'id': 'cb386063-39c7-587d-ad9a-ff6800bae828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV64774',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 236390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-30 11:56:25 [auto1.be] INFO: Saving data for NV64774: {'auction_closing_time': 1774884910.0, 'created_time': 1774697793.043121, 'last_price_update_time': 1774871785.444704}
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV64774') HTTP/1.1" 204 0
2026-03-30 11:56:25 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1774 | hits on page: 40
2026-03-30 11:56:25 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-30 11:56:25 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-30 11:56:25 [auto1.be] INFO: Scrape type for ET88330: 2
2026-03-30 11:56:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-30 11:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3911d70-a36f-595b-859c-a5e9fd60ea09 with scrape type 2
2026-03-30 11:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3911d70-a36f-595b-859c-a5e9fd60ea09 with scrape type 2
2026-03-30 11:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3911d70-a36f-595b-859c-a5e9fd60ea09, identifier: ET88330
2026-03-30 11:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 11:56:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-30 11:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330 to the API
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:49Z',
 'fuel_type': 'petrol',
 'id': 'e3911d70-a36f-595b-859c-a5e9fd60ea09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET88330',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 25368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-23',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2010}
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-30 11:56:26 [auto1.be] INFO: Saving data for ET88330: {'auction_closing_time': 1774883869.0, 'created_time': 1774697735.307143, 'last_price_update_time': 1774871786.08915}
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET88330') HTTP/1.1" 204 0
2026-03-30 11:56:26 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-30 11:56:26 [auto1.be] INFO: Scrape type for FC78029: 2
2026-03-30 11:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-30 11:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c0a291-758d-505c-bbb5-f0981838f388 with scrape type 2
2026-03-30 11:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c0a291-758d-505c-bbb5-f0981838f388 with scrape type 2
2026-03-30 11:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78c0a291-758d-505c-bbb5-f0981838f388, identifier: FC78029
2026-03-30 11:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:26 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-30 11:56:26 [auto1.be] INFO: Scrape type for KT00341: 2
2026-03-30 11:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-30 11:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b176a8a-6962-5823-864c-71ed348166ca with scrape type 2
2026-03-30 11:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b176a8a-6962-5823-864c-71ed348166ca with scrape type 2
2026-03-30 11:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b176a8a-6962-5823-864c-71ed348166ca, identifier: KT00341
2026-03-30 11:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-30 11:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-30 11:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029 to the API
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:34:46Z',
 'fuel_type': 'petrol',
 'id': '78c0a291-758d-505c-bbb5-f0981838f388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC78029',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 132105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2014}
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-30 11:56:26 [auto1.be] INFO: Saving data for FC78029: {'auction_closing_time': 1774884886.0, 'created_time': 1774697737.764261, 'last_price_update_time': 1774871786.616365}
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC78029') HTTP/1.1" 204 0
2026-03-30 11:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-30 11:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-30 11:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341 to the API
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:57:44Z',
 'fuel_type': 'diesel',
 'id': '8b176a8a-6962-5823-864c-71ed348166ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT00341',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 265642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-23',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline',
 'year': 2011}
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-30 11:56:26 [auto1.be] INFO: Saving data for KT00341: {'auction_closing_time': 1774886264.0, 'created_time': 1774039053.491047, 'last_price_update_time': 1774871786.91279}
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT00341') HTTP/1.1" 204 0
2026-03-30 11:56:26 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-30 11:56:26 [auto1.be] INFO: Scrape type for EH00335: 2
2026-03-30 11:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-30 11:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbfe6a6-a285-5ee5-bd85-8a3050595475 with scrape type 2
2026-03-30 11:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbfe6a6-a285-5ee5-bd85-8a3050595475 with scrape type 2
2026-03-30 11:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cdbfe6a6-a285-5ee5-bd85-8a3050595475, identifier: EH00335
2026-03-30 11:56:27 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-30 11:56:27 [auto1.be] INFO: Scrape type for YH90615: 2
2026-03-30 11:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-30 11:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c351e18-f3a9-5a23-85d4-dcfc5693610c with scrape type 2
2026-03-30 11:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c351e18-f3a9-5a23-85d4-dcfc5693610c with scrape type 2
2026-03-30 11:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0c351e18-f3a9-5a23-85d4-dcfc5693610c, identifier: YH90615
2026-03-30 11:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-30 11:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-30 11:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335 to the API
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:39Z',
 'fuel_type': 'diesel',
 'id': 'cdbfe6a6-a285-5ee5-bd85-8a3050595475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH00335',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 197427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-30 11:56:27 [auto1.be] INFO: Saving data for EH00335: {'auction_closing_time': 1774884279.0, 'created_time': 1774697744.108818, 'last_price_update_time': 1774871787.429568}
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EH00335') HTTP/1.1" 204 0
2026-03-30 11:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-30 11:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-30 11:56:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615 to the API
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:34Z',
 'fuel_type': 'petrol',
 'id': '0c351e18-f3a9-5a23-85d4-dcfc5693610c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH90615',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 113628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-11',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-30 11:56:27 [auto1.be] INFO: Saving data for YH90615: {'auction_closing_time': 1774885114.0, 'created_time': 1774039062.988824, 'last_price_update_time': 1774871787.709068}
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH90615') HTTP/1.1" 204 0
2026-03-30 11:56:27 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-30 11:56:27 [auto1.be] INFO: Scrape type for WH49963: 2
2026-03-30 11:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-30 11:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3366934-d91c-5156-a369-650665629474 with scrape type 2
2026-03-30 11:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3366934-d91c-5156-a369-650665629474 with scrape type 2
2026-03-30 11:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3366934-d91c-5156-a369-650665629474, identifier: WH49963
2026-03-30 11:56:27 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-30 11:56:27 [auto1.be] INFO: Scrape type for CU35051: 2
2026-03-30 11:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-30 11:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf76b278-56a0-5646-a2a7-de1723011ba0 with scrape type 2
2026-03-30 11:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf76b278-56a0-5646-a2a7-de1723011ba0 with scrape type 2
2026-03-30 11:56:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf76b278-56a0-5646-a2a7-de1723011ba0, identifier: CU35051
2026-03-30 11:56:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-30 11:56:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-30 11:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963 to the API
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:00:35Z',
 'fuel_type': 'hybrid',
 'id': 'a3366934-d91c-5156-a369-650665629474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH49963',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 76700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-30 11:56:28 [auto1.be] INFO: Saving data for WH49963: {'auction_closing_time': 1774882835.0, 'created_time': 1774697745.557079, 'last_price_update_time': 1774871788.206758}
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH49963') HTTP/1.1" 204 0
2026-03-30 11:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-30 11:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-30 11:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051 to the API
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'diesel',
 'id': 'cf76b278-56a0-5646-a2a7-de1723011ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU35051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 206651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-30 11:56:28 [auto1.be] INFO: Saving data for CU35051: {'auction_closing_time': 1774886122.0, 'created_time': 1774697759.542206, 'last_price_update_time': 1774871788.483541}
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU35051') HTTP/1.1" 204 0
2026-03-30 11:56:28 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-30 11:56:28 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-30 11:56:28 [auto1.be] INFO: Scrape type for KL53758: 2
2026-03-30 11:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-30 11:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with scrape type 2
2026-03-30 11:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with scrape type 2
2026-03-30 11:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868, identifier: KL53758
2026-03-30 11:56:28 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-30 11:56:28 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-30 11:56:28 [auto1.be] INFO: Scrape type for PK02246: 2
2026-03-30 11:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-30 11:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03849ee2-b597-56b3-a949-37d7f86bb163 with scrape type 2
2026-03-30 11:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03849ee2-b597-56b3-a949-37d7f86bb163 with scrape type 2
2026-03-30 11:56:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 03849ee2-b597-56b3-a949-37d7f86bb163, identifier: PK02246
2026-03-30 11:56:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-30 11:56:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-30 11:56:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758 to the API
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'diesel',
 'id': 'cb2cc3eb-4d6f-5034-bb20-95c2a2a10868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53758',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 153835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2016}
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.be] INFO: Saving data for KL53758: {'auction_closing_time': 1774885961.0, 'created_time': 1774697743.73254, 'last_price_update_time': 1774871789.044144}
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KL53758') HTTP/1.1" 204 0
2026-03-30 11:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-30 11:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-30 11:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246 to the API
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:42Z',
 'fuel_type': 'petrol',
 'id': '03849ee2-b597-56b3-a949-37d7f86bb163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK02246',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 130656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-21',
 'seller_name': None,
 'title': 'Renault Clio 1.2 TCe Energy Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.be] INFO: Saving data for PK02246: {'auction_closing_time': 1774883382.0, 'created_time': 1774697746.98808, 'last_price_update_time': 1774871789.542127}
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK02246') HTTP/1.1" 204 0
2026-03-30 11:56:29 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-30 11:56:29 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.be] INFO: Scrape type for RA73981: 2
2026-03-30 11:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-30 11:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with scrape type 2
2026-03-30 11:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with scrape type 2
2026-03-30 11:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c, identifier: RA73981
2026-03-30 11:56:29 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-30 11:56:29 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-30 11:56:29 [auto1.be] INFO: Scrape type for LY17098: 2
2026-03-30 11:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-30 11:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with scrape type 2
2026-03-30 11:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with scrape type 2
2026-03-30 11:56:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5, identifier: LY17098
2026-03-30 11:56:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-30 11:56:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-30 11:56:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981 to the API
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:09:45Z',
 'fuel_type': 'diesel',
 'id': '4c9c6e8a-198e-5a44-af19-4d58da22fa0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA73981',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 282378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2008}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.be] INFO: Saving data for RA73981: {'auction_closing_time': 1774883385.0, 'created_time': 1774697734.637786, 'last_price_update_time': 1774871790.051721}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA73981') HTTP/1.1" 204 0
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-30 11:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-30 11:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098 to the API
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:34:08Z',
 'fuel_type': 'petrol',
 'id': '3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY17098',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 194581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-02',
 'seller_name': None,
 'title': 'Kia Carens 1.6 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2009}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.be] INFO: Saving data for LY17098: {'auction_closing_time': 1774884848.0, 'created_time': 1774697738.073627, 'last_price_update_time': 1774871790.353683}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY17098') HTTP/1.1" 204 0
2026-03-30 11:56:30 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.be] INFO: Scrape type for EJ96142: 2
2026-03-30 11:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-30 11:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb779073-baaf-5e6e-a125-614e69685435 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb779073-baaf-5e6e-a125-614e69685435 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb779073-baaf-5e6e-a125-614e69685435, identifier: EJ96142
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-30 11:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-30 11:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142 to the API
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'diesel',
 'id': 'bb779073-baaf-5e6e-a125-614e69685435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ96142',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 96641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2012}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.be] INFO: Saving data for EJ96142: {'auction_closing_time': 1774883052.0, 'created_time': 1774697748.264964, 'last_price_update_time': 1774871790.745383}
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ96142') HTTP/1.1" 204 0
2026-03-30 11:56:30 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.be] INFO: Scrape type for HE39793: 2
2026-03-30 11:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-30 11:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504aed41-bf6e-5884-9e2f-adf46851589d with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504aed41-bf6e-5884-9e2f-adf46851589d with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 504aed41-bf6e-5884-9e2f-adf46851589d, identifier: HE39793
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-30 11:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-30 11:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793 to the API
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:34:25Z',
 'fuel_type': 'petrol',
 'id': '504aed41-bf6e-5884-9e2f-adf46851589d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE39793',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 81585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.be] INFO: Saving data for HE39793: {'auction_closing_time': 1774884865.0, 'created_time': 1774697751.583659, 'last_price_update_time': 1774871791.463297}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE39793') HTTP/1.1" 204 0
2026-03-30 11:56:31 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.be] INFO: Scrape type for DD83263: 2
2026-03-30 11:56:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-30 11:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32743c6-2b98-5c6e-87ba-bcd434b3cace with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32743c6-2b98-5c6e-87ba-bcd434b3cace with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c32743c6-2b98-5c6e-87ba-bcd434b3cace, identifier: DD83263
2026-03-30 11:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-30 11:56:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-30 11:56:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263 to the API
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:48Z',
 'fuel_type': 'diesel',
 'id': 'c32743c6-2b98-5c6e-87ba-bcd434b3cace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD83263',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 135430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2018}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.be] INFO: Saving data for DD83263: {'auction_closing_time': 1774884108.0, 'created_time': 1774697746.642094, 'last_price_update_time': 1774871791.925913}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD83263') HTTP/1.1" 204 0
2026-03-30 11:56:31 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-30 11:56:31 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.be] INFO: Scrape type for SW21472: 2
2026-03-30 11:56:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-30 11:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e819c02d-4bb2-55db-8d4e-fce41dacd5cf with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e819c02d-4bb2-55db-8d4e-fce41dacd5cf with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e819c02d-4bb2-55db-8d4e-fce41dacd5cf, identifier: SW21472
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-30 11:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472 to the API
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:21:26Z',
 'fuel_type': 'petrol',
 'id': 'e819c02d-4bb2-55db-8d4e-fce41dacd5cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW21472',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 222777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-16',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.be] INFO: Saving data for SW21472: {'auction_closing_time': 1774884086.0, 'created_time': 1774697736.187641, 'last_price_update_time': 1774871792.34759}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW21472') HTTP/1.1" 204 0
2026-03-30 11:56:32 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-30 11:56:32 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-30 11:56:32 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.be] INFO: Scrape type for EY57880: 2
2026-03-30 11:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-30 11:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c, identifier: EY57880
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-30 11:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880 to the API
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:48Z',
 'fuel_type': 'petrol',
 'id': '70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY57880',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 95241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.be] INFO: Saving data for EY57880: {'auction_closing_time': 1774885968.0, 'created_time': 1774697747.628706, 'last_price_update_time': 1774871792.755252}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EY57880') HTTP/1.1" 204 0
2026-03-30 11:56:32 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-30 11:56:32 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-30 11:56:32 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.be] INFO: Scrape type for ZN56944: 2
2026-03-30 11:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-30 11:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cdb666-0057-5970-95f1-d0c19635898b with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36cdb666-0057-5970-95f1-d0c19635898b with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 36cdb666-0057-5970-95f1-d0c19635898b, identifier: ZN56944
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-30 11:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944 to the API
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:11Z',
 'fuel_type': 'diesel',
 'id': '36cdb666-0057-5970-95f1-d0c19635898b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN56944',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 148676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.be] INFO: Saving data for ZN56944: {'auction_closing_time': 1774883231.0, 'created_time': 1774697783.876837, 'last_price_update_time': 1774871793.266419}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN56944') HTTP/1.1" 204 0
2026-03-30 11:56:33 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-30 11:56:33 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.be] INFO: Scrape type for HX50025: 2
2026-03-30 11:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-30 11:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14, identifier: HX50025
2026-03-30 11:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-30 11:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-30 11:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025 to the API
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'diesel',
 'id': '2e6c0b59-8a39-5bbd-b079-1bea41edcf14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX50025',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 144487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.be] INFO: Saving data for HX50025: {'auction_closing_time': 1774883847.0, 'created_time': 1774697787.47083, 'last_price_update_time': 1774871793.661594}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX50025') HTTP/1.1" 204 0
2026-03-30 11:56:33 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.be] INFO: Scrape type for DH53723: 2
2026-03-30 11:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-30 11:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20f0804-3982-5a38-b306-11f616ad2e80 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20f0804-3982-5a38-b306-11f616ad2e80 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b20f0804-3982-5a38-b306-11f616ad2e80, identifier: DH53723
2026-03-30 11:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-30 11:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-30 11:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723 to the API
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:08:30Z',
 'fuel_type': 'diesel',
 'id': 'b20f0804-3982-5a38-b306-11f616ad2e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH53723',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 129982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-19',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2019}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.be] INFO: Saving data for DH53723: {'auction_closing_time': 1774883310.0, 'created_time': 1774697776.373988, 'last_price_update_time': 1774871794.119445}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH53723') HTTP/1.1" 204 0
2026-03-30 11:56:34 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-30 11:56:34 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.be] INFO: Scrape type for RD62823: 2
2026-03-30 11:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-30 11:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b, identifier: RD62823
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-30 11:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-30 11:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823 to the API
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:11Z',
 'fuel_type': 'petrol',
 'id': '0d409237-307b-5e19-8cb0-ecf6fed7aa3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD62823',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 137580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-20',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Latitude',
 'transmission': 'manual',
 'trim': 'Latitude',
 'year': 2008}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.be] INFO: Saving data for RD62823: {'auction_closing_time': 1774884491.0, 'created_time': 1773384047.537483, 'last_price_update_time': 1774871794.55387}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD62823') HTTP/1.1" 204 0
2026-03-30 11:56:34 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1774 | hits on page: 40
2026-03-30 11:56:34 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-30 11:56:34 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-30 11:56:34 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.be] INFO: Scrape type for ZG72967: 2
2026-03-30 11:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-30 11:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6255b3bf-184a-5247-9765-2476d5bb33fc with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6255b3bf-184a-5247-9765-2476d5bb33fc with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6255b3bf-184a-5247-9765-2476d5bb33fc, identifier: ZG72967
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-30 11:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967 to the API
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:05:07Z',
 'fuel_type': 'petrol',
 'id': '6255b3bf-184a-5247-9765-2476d5bb33fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG72967',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 69929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-06',
 'seller_name': None,
 'title': 'Fiat Fiorino 1.4 SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2010}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.be] INFO: Saving data for ZG72967: {'auction_closing_time': 1774883107.0, 'created_time': 1774697798.380371, 'last_price_update_time': 1774871795.237987}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG72967') HTTP/1.1" 204 0
2026-03-30 11:56:35 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.be] INFO: Scrape type for TC61218: 2
2026-03-30 11:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-30 11:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c70514e2-cfa6-53b4-966f-1ba51a7b9e60, identifier: TC61218
2026-03-30 11:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:35 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-30 11:56:35 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.be] INFO: Scrape type for UH00217: 2
2026-03-30 11:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-30 11:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad0aba6a-691f-5c26-962e-c15486b0fbab with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad0aba6a-691f-5c26-962e-c15486b0fbab with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad0aba6a-691f-5c26-962e-c15486b0fbab, identifier: UH00217
2026-03-30 11:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-30 11:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-30 11:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218 to the API
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:29Z',
 'fuel_type': 'petrol',
 'id': 'c70514e2-cfa6-53b4-966f-1ba51a7b9e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC61218',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 78437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-04-29',
 'seller_name': None,
 'title': "Opel Tigra 1.4 Color Line 'Chequers'",
 'transmission': 'manual',
 'trim': "Color Line 'Chequers'",
 'year': 1999}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.be] INFO: Saving data for TC61218: {'auction_closing_time': 1774884269.0, 'created_time': 1774697792.341597, 'last_price_update_time': 1774871795.949268}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC61218') HTTP/1.1" 204 0
2026-03-30 11:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-30 11:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-30 11:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217 to the API
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:02Z',
 'fuel_type': 'diesel',
 'id': 'ad0aba6a-691f-5c26-962e-c15486b0fbab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH00217',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 263712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.8 DI-D ClearTec EDITION',
 'transmission': 'manual',
 'trim': 'ClearTec EDITION',
 'year': 2012}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.be] INFO: Saving data for UH00217: {'auction_closing_time': 1774885082.0, 'created_time': 1774697800.667137, 'last_price_update_time': 1774871796.219463}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UH00217') HTTP/1.1" 204 0
2026-03-30 11:56:36 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.be] INFO: Scrape type for PP72448: 2
2026-03-30 11:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-30 11:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c, identifier: PP72448
2026-03-30 11:56:36 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-30 11:56:36 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-30 11:56:36 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.be] INFO: Scrape type for EU75132: 2
2026-03-30 11:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-30 11:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866a5601-cd8e-5d41-9c03-ee135e528231 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 866a5601-cd8e-5d41-9c03-ee135e528231 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 866a5601-cd8e-5d41-9c03-ee135e528231, identifier: EU75132
2026-03-30 11:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-30 11:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-30 11:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448 to the API
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:20Z',
 'fuel_type': 'diesel',
 'id': 'a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP72448',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 79106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-01',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium AWD',
 'transmission': 'automatic',
 'trim': 'Titanium AWD',
 'year': 2019}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.be] INFO: Saving data for PP72448: {'auction_closing_time': 1774884920.0, 'created_time': 1774697787.941228, 'last_price_update_time': 1774871796.72583}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PP72448') HTTP/1.1" 204 0
2026-03-30 11:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-30 11:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-30 11:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132 to the API
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:40:06Z',
 'fuel_type': 'diesel',
 'id': '866a5601-cd8e-5d41-9c03-ee135e528231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU75132',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 199855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.be] INFO: Saving data for EU75132: {'auction_closing_time': 1774885206.0, 'created_time': 1774697773.307018, 'last_price_update_time': 1774871797.061122}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU75132') HTTP/1.1" 204 0
2026-03-30 11:56:37 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.be] INFO: Scrape type for EV21741: 2
2026-03-30 11:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-30 11:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4, identifier: EV21741
2026-03-30 11:56:37 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.be] INFO: Scrape type for JY01361: 2
2026-03-30 11:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-30 11:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8275dd1c-4360-5681-bf44-7a58ec55484a with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8275dd1c-4360-5681-bf44-7a58ec55484a with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8275dd1c-4360-5681-bf44-7a58ec55484a, identifier: JY01361
2026-03-30 11:56:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-30 11:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-30 11:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741 to the API
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': 'b990d3ba-1fec-55d2-b815-9ecfdbfdbee4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV21741',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 181063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.be] INFO: Saving data for EV21741: {'auction_closing_time': 1774883596.0, 'created_time': 1774697796.088869, 'last_price_update_time': 1774871797.638314}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV21741') HTTP/1.1" 204 0
2026-03-30 11:56:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-30 11:56:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-30 11:56:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361 to the API
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:32Z',
 'fuel_type': 'diesel',
 'id': '8275dd1c-4360-5681-bf44-7a58ec55484a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY01361',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 136779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-17',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.be] INFO: Saving data for JY01361: {'auction_closing_time': 1774883252.0, 'created_time': 1774697781.569314, 'last_price_update_time': 1774871797.944444}
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY01361') HTTP/1.1" 204 0
2026-03-30 11:56:37 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-30 11:56:37 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-30 11:56:37 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.be] INFO: Scrape type for BZ95673: 2
2026-03-30 11:56:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-30 11:56:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010df3b2-67e1-515a-9167-f86a53c05da9 with scrape type 2
2026-03-30 11:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 010df3b2-67e1-515a-9167-f86a53c05da9 with scrape type 2
2026-03-30 11:56:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 010df3b2-67e1-515a-9167-f86a53c05da9, identifier: BZ95673
2026-03-30 11:56:38 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-30 11:56:38 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-30 11:56:38 [auto1.be] INFO: Scrape type for FK09845: 2
2026-03-30 11:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-30 11:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with scrape type 2
2026-03-30 11:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with scrape type 2
2026-03-30 11:56:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6, identifier: FK09845
2026-03-30 11:56:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-30 11:56:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-30 11:56:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673 to the API
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:47Z',
 'fuel_type': 'diesel',
 'id': '010df3b2-67e1-515a-9167-f86a53c05da9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ95673',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 168075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-22',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-30 11:56:38 [auto1.be] INFO: Saving data for BZ95673: {'auction_closing_time': 1774885667.0, 'created_time': 1774697797.474401, 'last_price_update_time': 1774871798.437418}
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ95673') HTTP/1.1" 204 0
2026-03-30 11:56:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-30 11:56:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-30 11:56:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845 to the API
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:35:45Z',
 'fuel_type': 'petrol',
 'id': 'c70a5763-970e-5a4e-bb73-d1ba5c51d2d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK09845',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-30 11:56:38 [auto1.be] INFO: Saving data for FK09845: {'auction_closing_time': 1774884945.0, 'created_time': 1774697781.210376, 'last_price_update_time': 1774871798.830925}
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK09845') HTTP/1.1" 204 0
2026-03-30 11:56:38 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-30 11:56:38 [auto1.be] INFO: Scrape type for AG16412: 2
2026-03-30 11:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-30 11:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b with scrape type 2
2026-03-30 11:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b with scrape type 2
2026-03-30 11:56:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2cc086b2-0d65-5036-b3a0-c7e36427d08b, identifier: AG16412
2026-03-30 11:56:38 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-30 11:56:38 [auto1.be] INFO: Scrape type for EB31921: 2
2026-03-30 11:56:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-30 11:56:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70a8686-eefe-5e47-99ce-6b9a88db00f5 with scrape type 2
2026-03-30 11:56:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b70a8686-eefe-5e47-99ce-6b9a88db00f5 with scrape type 2
2026-03-30 11:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b70a8686-eefe-5e47-99ce-6b9a88db00f5, identifier: EB31921
2026-03-30 11:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-30 11:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-30 11:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412 to the API
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:02Z',
 'fuel_type': 'petrol',
 'id': '2cc086b2-0d65-5036-b3a0-c7e36427d08b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG16412',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 118041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT Ambiente ultra',
 'transmission': 'automatic',
 'trim': 'Ambiente ultra',
 'year': 2014}
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-30 11:56:39 [auto1.be] INFO: Saving data for AG16412: {'auction_closing_time': 1774884422.0, 'created_time': 1774697802.152202, 'last_price_update_time': 1774871799.329394}
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG16412') HTTP/1.1" 204 0
2026-03-30 11:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-30 11:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-30 11:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921 to the API
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:13:52Z',
 'fuel_type': 'diesel',
 'id': 'b70a8686-eefe-5e47-99ce-6b9a88db00f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB31921',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 224762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 CRDi Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-30 11:56:39 [auto1.be] INFO: Saving data for EB31921: {'auction_closing_time': 1774883632.0, 'created_time': 1774697782.226079, 'last_price_update_time': 1774871799.614599}
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB31921') HTTP/1.1" 204 0
2026-03-30 11:56:39 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-30 11:56:39 [auto1.be] INFO: Scrape type for TM16327: 2
2026-03-30 11:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-30 11:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3049ee2d-7293-504a-9175-7f72795d5e40 with scrape type 2
2026-03-30 11:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3049ee2d-7293-504a-9175-7f72795d5e40 with scrape type 2
2026-03-30 11:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3049ee2d-7293-504a-9175-7f72795d5e40, identifier: TM16327
2026-03-30 11:56:39 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-30 11:56:39 [auto1.be] INFO: Scrape type for DJ63605: 2
2026-03-30 11:56:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-30 11:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with scrape type 2
2026-03-30 11:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with scrape type 2
2026-03-30 11:56:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40, identifier: DJ63605
2026-03-30 11:56:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-30 11:56:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-30 11:56:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327 to the API
2026-03-30 11:56:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:05Z',
 'fuel_type': 'diesel',
 'id': '3049ee2d-7293-504a-9175-7f72795d5e40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM16327',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 224368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-06',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Saving data for TM16327: {'auction_closing_time': 1774884365.0, 'created_time': 1774697770.682946, 'last_price_update_time': 1774871800.143288}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM16327') HTTP/1.1" 204 0
2026-03-30 11:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-30 11:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-30 11:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605 to the API
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:01Z',
 'fuel_type': 'petrol',
 'id': 'c91f71ac-999d-54f8-b90c-1b6fcb4c8f40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ63605',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 107256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Saving data for DJ63605: {'auction_closing_time': 1774883281.0, 'created_time': 1774697787.104539, 'last_price_update_time': 1774871800.432179}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ63605') HTTP/1.1" 204 0
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Scrape type for UC18604: 2
2026-03-30 11:56:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-30 11:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b173c489-7538-5260-a6f8-21e29901460c with scrape type 2
2026-03-30 11:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b173c489-7538-5260-a6f8-21e29901460c with scrape type 2
2026-03-30 11:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b173c489-7538-5260-a6f8-21e29901460c, identifier: UC18604
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: US61346
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-30 11:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-30 11:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-30 11:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604 to the API
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:11:24Z',
 'fuel_type': 'diesel',
 'id': 'b173c489-7538-5260-a6f8-21e29901460c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC18604',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 108276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2H1 29 Kasten',
 'transmission': 'manual',
 'trim': 'L2H1 29 Kasten',
 'year': 2014}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Saving data for UC18604: {'auction_closing_time': 1774883484.0, 'created_time': 1774697788.703516, 'last_price_update_time': 1774871800.862354}
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC18604') HTTP/1.1" 204 0
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Scrape type for TF70513: 0
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Scrape type for ZD95004: 0
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Scrape type for PC01829: 0
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-30 11:56:40 [auto1.be] INFO: Scrape type for RW32127: 0
2026-03-30 11:56:40 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-30 11:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for CE27208: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for CG81228: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for WN54122: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for UA48921: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for RY49845: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for ZT87936: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for VZ26828: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for KR16689: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for YV20290: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for LK52725: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for TS84713: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for HY97997: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-30 11:56:41 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-30 11:56:41 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-30 11:57:06 [scrapy.extensions.logstats] INFO: Crawled 224 pages (at 4 pages/min), scraped 208 items (at 60 items/min)
2026-03-30 11:57:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-30 11:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:45 [auto1.be] INFO: Channel: 24h | Page: 45 | totalHits: 1774 | hits on page: 14
2026-03-30 11:57:45 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-30 11:57:45 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-30 11:57:45 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-30 11:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-30 11:57:45 [auto1.be] INFO: Scrape type for GF35922: 2
2026-03-30 11:57:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-30 11:57:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with scrape type 2
2026-03-30 11:57:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with scrape type 2
2026-03-30 11:57:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cba50ece-3db1-5e5e-bc62-65ab11f30ab1, identifier: GF35922
2026-03-30 11:57:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-30 11:57:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-30 11:57:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922 to the API
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'diesel',
 'id': 'cba50ece-3db1-5e5e-bc62-65ab11f30ab1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF35922',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 124830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-19',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2017}
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-30 11:57:46 [auto1.be] INFO: Saving data for GF35922: {'auction_closing_time': 1774883700.0, 'created_time': 1774006547.455712, 'last_price_update_time': 1774871866.319902}
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF35922') HTTP/1.1" 204 0
2026-03-30 11:57:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-30 11:57:46 [auto1.be] INFO: Scrape type for BR73229: 0
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-30 11:57:46 [auto1.be] INFO: Scrape type for BB63081: 0
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-30 11:57:46 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-30 11:57:46 [auto1.be] INFO: Scrape type for XR93319: 0
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-30 11:57:46 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-30 11:57:46 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-30 11:57:46 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-30 11:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:50 [auto1.be] INFO: Channel: 24h | Page: 46 | totalHits: 1774 | hits on page: 0
2026-03-30 11:57:50 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 11:57:50 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-30 11:57:50 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 6, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-30 11:57:50 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (209 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-30T11_35_00.jl
2026-03-30 11:57:50 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1387850,
 'downloader/request_count': 786,
 'downloader/request_method_count/GET': 738,
 'downloader/request_method_count/POST': 48,
 'downloader/response_bytes': 132000749,
 'downloader/response_count': 786,
 'downloader/response_status_count/200': 786,
 'dupefilter/filtered': 15,
 'elapsed_time_seconds': 1363.838817,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 11, 57, 50, 813738, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 209,
 'log_count/DEBUG': 8488,
 'log_count/INFO': 8851,
 'memusage/max': 180822016,
 'memusage/startup': 147824640,
 'photo_download_count': 560,
 'request_depth_max': 49,
 'response_received_count': 226,
 'scheduler/dequeued': 786,
 'scheduler/dequeued/memory': 786,
 'scheduler/enqueued': 786,
 'scheduler/enqueued/memory': 786,
 'scrape_type/batch_skipped': 910,
 'scrape_type/new': 88,
 'scrape_type/price_update': 121,
 'scrape_type/skipped': 680,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 256,
 'scrapy-zyte-api/error_ratio': 0.1171875,
 'scrapy-zyte-api/errors': 30,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 30,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 11.915896084495467,
 'scrapy-zyte-api/mean_response_seconds': 11.958459672394456,
 'scrapy-zyte-api/processed': 226,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 226,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 225,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 226,
 'scrapy-zyte-api/request_args/httpRequestBody': 48,
 'scrapy-zyte-api/request_args/httpRequestMethod': 48,
 'scrapy-zyte-api/request_args/httpResponseBody': 226,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 226,
 'scrapy-zyte-api/request_args/sessionContext': 226,
 'scrapy-zyte-api/request_args/url': 226,
 'scrapy-zyte-api/status_codes/0': 30,
 'scrapy-zyte-api/status_codes/200': 226,
 'scrapy-zyte-api/success': 226,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1814,
 'source/total_available': 1774,
 'start_time': datetime.datetime(2026, 3, 30, 11, 35, 6, 974921, tzinfo=datetime.timezone.utc)}
2026-03-30 11:57:50 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 11:57:50 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f73de862110>
2026-03-30 11:57:50 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f73de862550>