2026-03-28 11:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 11:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 11:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-28 11:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 11:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 11:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 11:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 11:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 11:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: bbbbf0448a07b376
2026-03-28 11:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 11:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-28T11_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 11:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 11:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 11:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-28 11:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 11:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 11:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 11:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 11:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 11:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 11:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 11:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-28 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 11:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 11:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 11:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 11:35:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1818 | hits on page: 40
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: AL59685
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for ZP95092: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for ZR35447: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: RK64902
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for CA54828: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for FW70524: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: CE40234
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE40234%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for CE40234: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for NZ74768: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for AC55620: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for YZ92764: 1
2026-03-28 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for ZZ63767: 1
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for VW23905: 1
2026-03-28 11:35:16 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-28 11:35:16 [auto1.be] INFO: Scrape type for BZ70123: 2
2026-03-28 11:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-28 11:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e86c8e1-36cc-5df4-8c16-d258792dff96 with scrape type 2
2026-03-28 11:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e86c8e1-36cc-5df4-8c16-d258792dff96 with scrape type 2
2026-03-28 11:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e86c8e1-36cc-5df4-8c16-d258792dff96, identifier: BZ70123
2026-03-28 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-28 11:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123 to the API
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:20:38Z',
 'fuel_type': 'diesel',
 'id': '4e86c8e1-36cc-5df4-8c16-d258792dff96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ70123',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 150432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-15',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2015}
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Saving data for BZ70123: {'auction_closing_time': 1774884038.0, 'created_time': 1773384489.030312, 'last_price_update_time': 1774697717.052688}
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ70123') HTTP/1.1" 204 0
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for XC95069: 1
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for BS70441: 1
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for GM14941: 1
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for SY87797: 1
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: VK18525
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK18525%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for VK18525: 1
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for WV78161: 2
2026-03-28 11:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-28 11:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with scrape type 2
2026-03-28 11:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with scrape type 2
2026-03-28 11:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c, identifier: WV78161
2026-03-28 11:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 11:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-28 11:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161 to the API
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:18:35Z',
 'fuel_type': 'diesel',
 'id': 'c86d0a7d-14b3-5db9-af01-0c5152bd3d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV78161',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 41439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-12',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
 'transmission': 'manual',
 'trim': 'Rapid Maxi Extra',
 'year': 2020}
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Saving data for WV78161: {'auction_closing_time': 1774883915.0, 'created_time': 1773384681.527128, 'last_price_update_time': 1774697717.801365}
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV78161') HTTP/1.1" 204 0
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for ZV95387: 1
2026-03-28 11:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP95092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for KB40459: 1
2026-03-28 11:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for ZZ39097: 1
2026-03-28 11:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for SC10935: 1
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-28 11:35:17 [auto1.be] INFO: Scrape type for BU18930: 1
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-28 11:35:17 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1818 | hits on page: 40
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: AL59685
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-28 11:35:17 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/ZP95092/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: RK64902
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: CE40234
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-28 11:35:17 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-28 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-28 11:35:18 [auto1.be] INFO: Scrape type for BZ70123: 0
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: VK18525
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-28 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-28 11:35:18 [auto1.be] INFO: Scrape type for WV78161: 0
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-28 11:35:18 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-28 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW70524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR35447/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA54828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC55620/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ92764/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE40234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ74768/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ63767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW23905/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC95069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS70441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM14941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV95387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK18525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY87797/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB40459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP95092> (referer: https://www.auto1.com/v1/car-details-view/ZP95092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-28 11:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a35d51-4951-5c9f-8818-3370273c76ff with scrape type 1
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 29a35d51-4951-5c9f-8818-3370273c76ff
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_967cce54d542c74b8844b1b181ae7864.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_967cce54d542c74b8844b1b181ae7864.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_59c76d2ec71117d032d4c43ce384ee22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_59c76d2ec71117d032d4c43ce384ee22.jpg not downloaded yet
2026-03-28 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ92764> (referer: https://www.auto1.com/v1/car-details-view/YZ92764/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_31da943c441b33fd81b93a84eaf39fc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_31da943c441b33fd81b93a84eaf39fc7.jpg not downloaded yet
2026-03-28 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_24de344077f7524fb15b8a168c6edbc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_24de344077f7524fb15b8a168c6edbc6.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_42a14d2648f9ab68fb281508c199909f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_42a14d2648f9ab68fb281508c199909f.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_f5583bc4a4e17af26a63f732ebd02150.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_f5583bc4a4e17af26a63f732ebd02150.jpg not downloaded yet
2026-03-28 11:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-28 11:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with scrape type 1
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_a69eeab9188f3f043ba0e7a4f9779bb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_a69eeab9188f3f043ba0e7a4f9779bb0.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_feb42b5561f9f33e5ccbc200856ff88a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_feb42b5561f9f33e5ccbc200856ff88a.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_fe60ee2129a707f12af0c52f9a3e1f98.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_fe60ee2129a707f12af0c52f9a3e1f98.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_cf26220b663cae55e57ccf1b6d7318f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_cf26220b663cae55e57ccf1b6d7318f3.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_52433b45639a7ec1ddd4f8f67403f112.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_52433b45639a7ec1ddd4f8f67403f112.jpg not downloaded yet
2026-03-28 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR35447> (referer: https://www.auto1.com/v1/car-details-view/ZR35447/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_6ebb83782cc69e82f8c28ec3843a1285.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_6ebb83782cc69e82f8c28ec3843a1285.jpg not downloaded yet
2026-03-28 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC55620> (referer: https://www.auto1.com/v1/car-details-view/AC55620/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-28 11:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db941a1-8645-5c6f-bbf7-fe200134479b with scrape type 1
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_649376025a7590b3d79c1bcf9242e1e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_649376025a7590b3d79c1bcf9242e1e8.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_0b7b717c5d92555beaf46cc66f094bd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0b7b717c5d92555beaf46cc66f094bd5.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_0346e0323b236284ac3e308b0dbab965.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0346e0323b236284ac3e308b0dbab965.jpg not downloaded yet
2026-03-28 11:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-28 11:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3505842-9219-5595-bcdf-7e483fd8cc77 with scrape type 1
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_76137c7d770b084f2407cdc8b9d8d82b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_76137c7d770b084f2407cdc8b9d8d82b.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_9c3b10c8f22e3a19febbb7875524e0a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9c3b10c8f22e3a19febbb7875524e0a9.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_df397c623a508e51892220ad528cb08a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_df397c623a508e51892220ad528cb08a.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_6c2d85e38fd1862dab799a7793df9a90.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_6c2d85e38fd1862dab799a7793df9a90.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_924a2fa20b187eae8ba72fb6b6b95b1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_924a2fa20b187eae8ba72fb6b6b95b1a.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_ad6e0858a1eb70c7816abc7ec83c5d7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_ad6e0858a1eb70c7816abc7ec83c5d7b.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_d013ddd48a5233c20bbab6d8c911f21e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d013ddd48a5233c20bbab6d8c911f21e.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_9641e47e4f45a1e840b10dd6f501689b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9641e47e4f45a1e840b10dd6f501689b.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_89d530ee43b351d316b5c9facb95bebd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_89d530ee43b351d316b5c9facb95bebd.jpg not downloaded yet
2026-03-28 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_59c76d2ec71117d032d4c43ce384ee22.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_06629df8ef2707f5120b65e41b0dc5bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_06629df8ef2707f5120b65e41b0dc5bc.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_583f01870f731cdf3448e5352e9dfd24.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_583f01870f731cdf3448e5352e9dfd24.jpg not downloaded yet
2026-03-28 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_6ebb83782cc69e82f8c28ec3843a1285.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_f43198339518df5130b1101a41d085bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_f43198339518df5130b1101a41d085bb.jpg not downloaded yet
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_d889dad9ade14ee2c31df0c4112647fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d889dad9ade14ee2c31df0c4112647fd.jpg not downloaded yet
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_d7d7728627e7ae3a5caadf428faf11cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_d7d7728627e7ae3a5caadf428faf11cf.jpg not downloaded yet
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_966c948eb207fbdd287f4c196248a126.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_966c948eb207fbdd287f4c196248a126.jpg not downloaded yet
2026-03-28 11:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA54828> (referer: https://www.auto1.com/v1/car-details-view/CA54828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW70524> (referer: https://www.auto1.com/v1/car-details-view/FW70524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_f56a7759637940276074b50d4130b9a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_f56a7759637940276074b50d4130b9a8.jpg not downloaded yet
2026-03-28 11:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_6cd3088c10c78219162e7c5ec1b82281.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_6cd3088c10c78219162e7c5ec1b82281.jpg not downloaded yet
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b36650>
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_59c76d2ec71117d032d4c43ce384ee22.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_59c76d2ec71117d032d4c43ce384ee22.jpg saved to cache
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29a35d51-4951-5c9f-8818-3370273c76ff
2026-03-28 11:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_52433b45639a7ec1ddd4f8f67403f112.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b51b90>
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_6ebb83782cc69e82f8c28ec3843a1285.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_6ebb83782cc69e82f8c28ec3843a1285.jpg saved to cache
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73
2026-03-28 11:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_89d530ee43b351d316b5c9facb95bebd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ74768> (referer: https://www.auto1.com/v1/car-details-view/NZ74768/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ63767> (referer: https://www.auto1.com/v1/car-details-view/ZZ63767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-28 11:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9659d86c-725d-5eda-90c3-5d685b1b8f6f with scrape type 1
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9659d86c-725d-5eda-90c3-5d685b1b8f6f
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_c33538b4c8b81122a239d78d9246277b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_c33538b4c8b81122a239d78d9246277b.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_81c35abddca50cedd65fd895712e76df.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_81c35abddca50cedd65fd895712e76df.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_43b0d7990f03ca0e54cb6d09523f91ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_43b0d7990f03ca0e54cb6d09523f91ba.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_a476afa32773dba5caf5a224979836bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_a476afa32773dba5caf5a224979836bf.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_54d81052a16fc57b36e8fca50a6a59d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_54d81052a16fc57b36e8fca50a6a59d3.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_22051a6739bc3779e79bec35df457e2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_22051a6739bc3779e79bec35df457e2a.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_cb1d4a0a8073f6b2a8f441fc58905c48.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_cb1d4a0a8073f6b2a8f441fc58905c48.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_08df32bf2df26b9bfdddb26785e0cf0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_08df32bf2df26b9bfdddb26785e0cf0c.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_3f41587bb29413e08b315abed471f2d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_3f41587bb29413e08b315abed471f2d6.jpg already downloaded
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fd4%252Fa4d4ae83da64ee8e0ef20afc219680ed%252Fpa%252FCA54828_393c7ad130c9dcd9e39e2609716ce8c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_393c7ad130c9dcd9e39e2609716ce8c9.jpg already downloaded
2026-03-28 11:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9659d86c-725d-5eda-90c3-5d685b1b8f6f, identifier: CA54828
2026-03-28 11:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-28 11:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with scrape type 1
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_c6ee210017156067a63034d3c122fbae.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c6ee210017156067a63034d3c122fbae.jpg not downloaded yet
2026-03-28 11:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-28 11:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828 to the API
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA54828>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:24:26Z',
 'fuel_type': 'petrol',
 'id': '9659d86c-725d-5eda-90c3-5d685b1b8f6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA54828',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 78578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_c33538b4c8b81122a239d78d9246277b.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_81c35abddca50cedd65fd895712e76df.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_43b0d7990f03ca0e54cb6d09523f91ba.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_a476afa32773dba5caf5a224979836bf.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_54d81052a16fc57b36e8fca50a6a59d3.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_22051a6739bc3779e79bec35df457e2a.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_cb1d4a0a8073f6b2a8f441fc58905c48.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_08df32bf2df26b9bfdddb26785e0cf0c.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_3f41587bb29413e08b315abed471f2d6.jpg',
                'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_393c7ad130c9dcd9e39e2609716ce8c9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_c33538b4c8b81122a239d78d9246277b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_81c35abddca50cedd65fd895712e76df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_43b0d7990f03ca0e54cb6d09523f91ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_a476afa32773dba5caf5a224979836bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_54d81052a16fc57b36e8fca50a6a59d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_22051a6739bc3779e79bec35df457e2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_cb1d4a0a8073f6b2a8f441fc58905c48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_08df32bf2df26b9bfdddb26785e0cf0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_3f41587bb29413e08b315abed471f2d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9659d86c-725d-5eda-90c3-5d685b1b8f6f/9659d86c-725d-5eda-90c3-5d685b1b8f6f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/d4/a4d4ae83da64ee8e0ef20afc219680ed/pa/CA54828_393c7ad130c9dcd9e39e2609716ce8c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [auto1.be] INFO: Saving data for CA54828: {'created_time': 1774697722.446956, 'last_price_update_time': 1774697722.446968, 'auction_closing_time': 1774884266.0}
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA54828') HTTP/1.1" 204 0
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_c7e1e1dc338d86643f61bad68e9d2575.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c7e1e1dc338d86643f61bad68e9d2575.jpg not downloaded yet
2026-03-28 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS70441> (referer: https://www.auto1.com/v1/car-details-view/BS70441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU18930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE40234> (referer: https://www.auto1.com/v1/car-details-view/CE40234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_f56a7759637940276074b50d4130b9a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_2413c3f0fc9e6714f5bcf88010d6819d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_2413c3f0fc9e6714f5bcf88010d6819d.jpg not downloaded yet
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cdfa8dd10>
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_52433b45639a7ec1ddd4f8f67403f112.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_52433b45639a7ec1ddd4f8f67403f112.jpg saved to cache
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b5c3d0>
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_89d530ee43b351d316b5c9facb95bebd.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_89d530ee43b351d316b5c9facb95bebd.jpg saved to cache
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-28 11:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82a8942-6e07-5172-a324-f6c919315007 with scrape type 1
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f82a8942-6e07-5172-a324-f6c919315007
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_c466100b2f780383a0a18441886815c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_c466100b2f780383a0a18441886815c8.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_6bfb4a05c074547ac8603702d934bf43.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_6bfb4a05c074547ac8603702d934bf43.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_ea1cdee135966c860434518b64fc401d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_ea1cdee135966c860434518b64fc401d.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_e9801c0d35e0f3683a1f78f543931751.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_e9801c0d35e0f3683a1f78f543931751.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_36a30d776b0ca135b77c25ac88580e17.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_36a30d776b0ca135b77c25ac88580e17.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_21055856faa2b1e179df402e1294db9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_21055856faa2b1e179df402e1294db9c.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_69909732fc8829ff834f7e13297e8db5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_69909732fc8829ff834f7e13297e8db5.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_84c752b7ae2a29524372eb8edbad2c7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_84c752b7ae2a29524372eb8edbad2c7e.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_ef1dc008aa02555db6e2efdfee1577b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_ef1dc008aa02555db6e2efdfee1577b5.jpg already downloaded
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F0e%252F1b0e76bd788d5e1cb72dd4a3298f130d%252Fpa%252FNZ74768_d95d37fdcbfc974ee12044f59c64bf22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_d95d37fdcbfc974ee12044f59c64bf22.jpg already downloaded
2026-03-28 11:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f82a8942-6e07-5172-a324-f6c919315007, identifier: NZ74768
2026-03-28 11:35:23 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1818 | hits on page: 40
2026-03-28 11:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-28 11:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94004ea2-ab18-5923-acab-dee180fd7603 with scrape type 1
2026-03-28 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 94004ea2-ab18-5923-acab-dee180fd7603
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f28c8a814c191fc5d9093cb05eab40a%252Fpa%252FZZ63767_821d1eb5ff3f2a050e02bbc0fed14920.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_821d1eb5ff3f2a050e02bbc0fed14920.jpg already downloaded
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f28c8a814c191fc5d9093cb05eab40a%252Fpa%252FZZ63767_d6a9d584126d1d7e679584cfbab9b61c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_d6a9d584126d1d7e679584cfbab9b61c.jpg already downloaded
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f28c8a814c191fc5d9093cb05eab40a%252Fpa%252FZZ63767_b42696fde3fcf84d4ae7ab1d7f40e444.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_b42696fde3fcf84d4ae7ab1d7f40e444.jpg already downloaded
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f28c8a814c191fc5d9093cb05eab40a%252Fpa%252FZZ63767_c672dd5bf806148421921a4004ce4b9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_c672dd5bf806148421921a4004ce4b9f.jpg already downloaded
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f28c8a814c191fc5d9093cb05eab40a%252Fpa%252FZZ63767_f999260b29ce9a44677ee8d529751aa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_f999260b29ce9a44677ee8d529751aa8.jpg already downloaded
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F28%252F9f28c8a814c191fc5d9093cb05eab40a%252Fpa%252FZZ63767_f9988ffa5d077f6e3ee1f0300c8f3292.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_f9988ffa5d077f6e3ee1f0300c8f3292.jpg already downloaded
2026-03-28 11:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94004ea2-ab18-5923-acab-dee180fd7603, identifier: ZZ63767
2026-03-28 11:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-28 11:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-28 11:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768 to the API
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ74768>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:48Z',
 'fuel_type': 'diesel',
 'id': 'f82a8942-6e07-5172-a324-f6c919315007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ74768',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Navara NP-300',
 'odometer': 63531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_c466100b2f780383a0a18441886815c8.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_6bfb4a05c074547ac8603702d934bf43.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_ea1cdee135966c860434518b64fc401d.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_e9801c0d35e0f3683a1f78f543931751.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_36a30d776b0ca135b77c25ac88580e17.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_21055856faa2b1e179df402e1294db9c.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_69909732fc8829ff834f7e13297e8db5.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_84c752b7ae2a29524372eb8edbad2c7e.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_ef1dc008aa02555db6e2efdfee1577b5.jpg',
                'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_d95d37fdcbfc974ee12044f59c64bf22.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_c466100b2f780383a0a18441886815c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_6bfb4a05c074547ac8603702d934bf43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_ea1cdee135966c860434518b64fc401d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_e9801c0d35e0f3683a1f78f543931751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_36a30d776b0ca135b77c25ac88580e17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_21055856faa2b1e179df402e1294db9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_69909732fc8829ff834f7e13297e8db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_84c752b7ae2a29524372eb8edbad2c7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_ef1dc008aa02555db6e2efdfee1577b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f82a8942-6e07-5172-a324-f6c919315007/f82a8942-6e07-5172-a324-f6c919315007_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/0e/1b0e76bd788d5e1cb72dd4a3298f130d/pa/NZ74768_d95d37fdcbfc974ee12044f59c64bf22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Navara NP-300 2.3 dCi N-Guard Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'N-Guard Double Cab 4x4',
 'year': 2021}
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [auto1.be] INFO: Saving data for NZ74768: {'created_time': 1774697723.542976, 'last_price_update_time': 1774697723.542988, 'auction_closing_time': 1774884168.0}
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ74768') HTTP/1.1" 204 0
2026-03-28 11:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 11:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-28 11:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767 to the API
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ63767>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:16:26Z',
 'fuel_type': 'diesel',
 'id': '94004ea2-ab18-5923-acab-dee180fd7603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ63767',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 210839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_821d1eb5ff3f2a050e02bbc0fed14920.jpg',
                'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_d6a9d584126d1d7e679584cfbab9b61c.jpg',
                'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_b42696fde3fcf84d4ae7ab1d7f40e444.jpg',
                'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_c672dd5bf806148421921a4004ce4b9f.jpg',
                'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_f999260b29ce9a44677ee8d529751aa8.jpg',
                'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_f9988ffa5d077f6e3ee1f0300c8f3292.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94004ea2-ab18-5923-acab-dee180fd7603/94004ea2-ab18-5923-acab-dee180fd7603_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_821d1eb5ff3f2a050e02bbc0fed14920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94004ea2-ab18-5923-acab-dee180fd7603/94004ea2-ab18-5923-acab-dee180fd7603_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_d6a9d584126d1d7e679584cfbab9b61c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94004ea2-ab18-5923-acab-dee180fd7603/94004ea2-ab18-5923-acab-dee180fd7603_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_b42696fde3fcf84d4ae7ab1d7f40e444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94004ea2-ab18-5923-acab-dee180fd7603/94004ea2-ab18-5923-acab-dee180fd7603_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_c672dd5bf806148421921a4004ce4b9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94004ea2-ab18-5923-acab-dee180fd7603/94004ea2-ab18-5923-acab-dee180fd7603_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_f999260b29ce9a44677ee8d529751aa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94004ea2-ab18-5923-acab-dee180fd7603/94004ea2-ab18-5923-acab-dee180fd7603_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/28/9f28c8a814c191fc5d9093cb05eab40a/pa/ZZ63767_f9988ffa5d077f6e3ee1f0300c8f3292.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.9 DI-D Family 1900',
 'transmission': 'manual',
 'trim': 'Family 1900',
 'year': 2004}
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-28 11:35:23 [auto1.be] INFO: Saving data for ZZ63767: {'created_time': 1774697723.967728, 'last_price_update_time': 1774697723.967741, 'auction_closing_time': 1774883786.0}
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ63767') HTTP/1.1" 204 0
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_c414c0624c4efdcd800d2d3f2a27b6ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c414c0624c4efdcd800d2d3f2a27b6ee.jpg not downloaded yet
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [auto1.be] INFO: Scrape type for CN37182: 1
2026-03-28 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC95069> (referer: https://www.auto1.com/v1/car-details-view/XC95069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM14941> (referer: https://www.auto1.com/v1/car-details-view/GM14941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-28 11:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e433a844-a689-5367-8714-653fee095003 with scrape type 1
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e433a844-a689-5367-8714-653fee095003
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_ebc02592857ef9f02ff9056eb73fbefa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_ebc02592857ef9f02ff9056eb73fbefa.jpg not downloaded yet
2026-03-28 11:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad137d48-5892-529d-9804-3a64ab9edc12 with identifier: CE40234
2026-03-28 11:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad137d48-5892-529d-9804-3a64ab9edc12 with scrape type 1
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ad137d48-5892-529d-9804-3a64ab9edc12
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_977096f547dc54ecd6489b1dae74e478.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_977096f547dc54ecd6489b1dae74e478.jpg not downloaded yet
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1413210>
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_f56a7759637940276074b50d4130b9a8.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_f56a7759637940276074b50d4130b9a8.jpg saved to cache
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_7b3c8a0d551fed85ae6577adf3d656ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_7b3c8a0d551fed85ae6577adf3d656ce.jpg not downloaded yet
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [auto1.be] INFO: Scrape type for EK79460: 2
2026-03-28 11:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-28 11:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c69946-e6f2-5427-8592-657055574d32 with scrape type 2
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c69946-e6f2-5427-8592-657055574d32 with scrape type 2
2026-03-28 11:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9c69946-e6f2-5427-8592-657055574d32, identifier: EK79460
2026-03-28 11:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-28 11:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-28 11:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460 to the API
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:02Z',
 'fuel_type': 'diesel',
 'id': 'f9c69946-e6f2-5427-8592-657055574d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK79460',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 122467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-21',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [auto1.be] INFO: Saving data for EK79460: {'auction_closing_time': 1774884122.0, 'created_time': 1773909357.314713, 'last_price_update_time': 1774697724.604241}
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK79460') HTTP/1.1" 204 0
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_60855c4a1262b0dddd3ad685a69d17e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_60855c4a1262b0dddd3ad685a69d17e3.jpg not downloaded yet
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_0799e92660f35ea2a09fb2fa4a617a69.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_0799e92660f35ea2a09fb2fa4a617a69.jpg not downloaded yet
2026-03-28 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_966c948eb207fbdd287f4c196248a126.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c7e1e1dc338d86643f61bad68e9d2575.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_69049c28ca9309fa3c9e9b9eddd82311.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_69049c28ca9309fa3c9e9b9eddd82311.jpg not downloaded yet
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [auto1.be] INFO: Scrape type for KE51169: 1
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_08a812932092b11f209ca4e34d51b6ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_08a812932092b11f209ca4e34d51b6ce.jpg not downloaded yet
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_713df8feca196b6b959b01ceda5c702a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_713df8feca196b6b959b01ceda5c702a.jpg not downloaded yet
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: JB88665
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB88665%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [auto1.be] INFO: Scrape type for JB88665: 1
2026-03-28 11:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-28 11:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2d479b-7554-5303-94e6-76865bc86c59 with scrape type 1
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_054e5e1f4347a11d0d36c86926ef5900.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_054e5e1f4347a11d0d36c86926ef5900.jpg not downloaded yet
2026-03-28 11:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-28 11:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a with scrape type 1
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_dbaa58556e08206139dacedcccd326f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_dbaa58556e08206139dacedcccd326f2.jpg not downloaded yet
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_007144d0d19368f9684e84050ec4a01c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_007144d0d19368f9684e84050ec4a01c.jpg not downloaded yet
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_c3efe0491d26de683f711211db445a01.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_c3efe0491d26de683f711211db445a01.jpg not downloaded yet
2026-03-28 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c6ee210017156067a63034d3c122fbae.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-28 11:35:24 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [auto1.be] INFO: Scrape type for XS76018: 1
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_37c7c162397c9bf214080f2a550969fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_37c7c162397c9bf214080f2a550969fe.jpg not downloaded yet
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_55554ce99ce3e70fd916f2b42120dfab.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_55554ce99ce3e70fd916f2b42120dfab.jpg not downloaded yet
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_6924b93cc7a323899e67e15d4f74f59e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_6924b93cc7a323899e67e15d4f74f59e.jpg not downloaded yet
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_f215bc5bd262a249d17becf72e372c56.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_f215bc5bd262a249d17becf72e372c56.jpg not downloaded yet
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd146a4d0>
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_966c948eb207fbdd287f4c196248a126.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_966c948eb207fbdd287f4c196248a126.jpg saved to cache
2026-03-28 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd097a090>
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_c7e1e1dc338d86643f61bad68e9d2575.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c7e1e1dc338d86643f61bad68e9d2575.jpg saved to cache
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9
2026-03-28 11:35:25 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [auto1.be] INFO: Scrape type for UY92003: 1
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_44da24089da745dd18190e95399e9324.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_44da24089da745dd18190e95399e9324.jpg not downloaded yet
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_1c00063eb5e4411cf3196c23ec68c645.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_1c00063eb5e4411cf3196c23ec68c645.jpg not downloaded yet
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK18525> (referer: https://www.auto1.com/v1/car-details-view/VK18525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB40459> (referer: https://www.auto1.com/v1/car-details-view/KB40459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY87797> (referer: https://www.auto1.com/v1/car-details-view/SY87797/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9641e47e4f45a1e840b10dd6f501689b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_583f01870f731cdf3448e5352e9dfd24.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_74812317316f6d82874fb534f79a588e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_74812317316f6d82874fb534f79a588e.jpg not downloaded yet
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_dfb19ffc5d1be942a07de1989f87767d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_dfb19ffc5d1be942a07de1989f87767d.jpg not downloaded yet
2026-03-28 11:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:25 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [auto1.be] INFO: Scrape type for NV64774: 1
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_6573f470d7ff0594848cc262d174d1a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_6573f470d7ff0594848cc262d174d1a5.jpg not downloaded yet
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_c35f8312fc0b8c16aad63eddf4112ee5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_c35f8312fc0b8c16aad63eddf4112ee5.jpg not downloaded yet
2026-03-28 11:35:25 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-28 11:35:25 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [auto1.be] INFO: Scrape type for ET88330: 1
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_041afe7357bffc492bfdd5d77e0e74b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_041afe7357bffc492bfdd5d77e0e74b5.jpg not downloaded yet
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_de47c25103dab53b5b2db2ffb3da2e10.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_de47c25103dab53b5b2db2ffb3da2e10.jpg not downloaded yet
2026-03-28 11:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09bd550>
2026-03-28 11:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_c6ee210017156067a63034d3c122fbae.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c6ee210017156067a63034d3c122fbae.jpg saved to cache
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d013ddd48a5233c20bbab6d8c911f21e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:25 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [auto1.be] INFO: Scrape type for KT00341: 2
2026-03-28 11:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-28 11:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b176a8a-6962-5823-864c-71ed348166ca with scrape type 2
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b176a8a-6962-5823-864c-71ed348166ca with scrape type 2
2026-03-28 11:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b176a8a-6962-5823-864c-71ed348166ca, identifier: KT00341
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_262b6e6f0133250c2f96f6a10fff53eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_262b6e6f0133250c2f96f6a10fff53eb.jpg not downloaded yet
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_ea1233fc8e96eb2d4afe75b4ad07566d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_ea1233fc8e96eb2d4afe75b4ad07566d.jpg not downloaded yet
2026-03-28 11:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac63ab8b-5a57-518e-8a93-9ff7350f7d58 with identifier: VK18525
2026-03-28 11:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58 with scrape type 1
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_5f7f70f58cf47b862cd8733aa2d0d2b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_5f7f70f58cf47b862cd8733aa2d0d2b1.jpg not downloaded yet
2026-03-28 11:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-28 11:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d42316a-0279-56f7-9b8e-5699d25c82b6 with scrape type 1
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_aad59994cff39fee530ce31fbecc79c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_aad59994cff39fee530ce31fbecc79c5.jpg not downloaded yet
2026-03-28 11:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-28 11:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e46d3f0-0807-5b96-8849-00972b4d6143 with scrape type 1
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_883d1b6bba46ec3d6755aebb4f37aade.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_883d1b6bba46ec3d6755aebb4f37aade.jpg not downloaded yet
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_7b3c8a0d551fed85ae6577adf3d656ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c414c0624c4efdcd800d2d3f2a27b6ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-28 11:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-28 11:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341 to the API
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:57:44Z',
 'fuel_type': 'diesel',
 'id': '8b176a8a-6962-5823-864c-71ed348166ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT00341',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 265642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-23',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline',
 'year': 2011}
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-28 11:35:25 [auto1.be] INFO: Saving data for KT00341: {'auction_closing_time': 1774886264.0, 'created_time': 1774039053.491047, 'last_price_update_time': 1774697725.90348}
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT00341') HTTP/1.1" 204 0
2026-03-28 11:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:26 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [auto1.be] INFO: Scrape type for YH90615: 2
2026-03-28 11:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-28 11:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c351e18-f3a9-5a23-85d4-dcfc5693610c with scrape type 2
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c351e18-f3a9-5a23-85d4-dcfc5693610c with scrape type 2
2026-03-28 11:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0c351e18-f3a9-5a23-85d4-dcfc5693610c, identifier: YH90615
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_f7c0d4980f000c5a1be8a8ee405664cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_f7c0d4980f000c5a1be8a8ee405664cc.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_caf01eb7a1615140592e259200b81a8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_caf01eb7a1615140592e259200b81a8b.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_f7650332f0b423fe79bccab03967fa4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_f7650332f0b423fe79bccab03967fa4b.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_f50d2468ec517321920f4b5cc12dfb24.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_f50d2468ec517321920f4b5cc12dfb24.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_b8a30f24238cafbae2abbee0af2d814f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_b8a30f24238cafbae2abbee0af2d814f.jpg not downloaded yet
2026-03-28 11:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-28 11:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-28 11:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615 to the API
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:34Z',
 'fuel_type': 'petrol',
 'id': '0c351e18-f3a9-5a23-85d4-dcfc5693610c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH90615',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 113628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-11',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [auto1.be] INFO: Saving data for YH90615: {'auction_closing_time': 1774885114.0, 'created_time': 1774039062.988824, 'last_price_update_time': 1774697726.540955}
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH90615') HTTP/1.1" 204 0
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b56550>
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_9641e47e4f45a1e840b10dd6f501689b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9641e47e4f45a1e840b10dd6f501689b.jpg saved to cache
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04a2550>
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_583f01870f731cdf3448e5352e9dfd24.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_583f01870f731cdf3448e5352e9dfd24.jpg saved to cache
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a56e90>
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_d013ddd48a5233c20bbab6d8c911f21e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d013ddd48a5233c20bbab6d8c911f21e.jpg saved to cache
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_977096f547dc54ecd6489b1dae74e478.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:26 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [auto1.be] INFO: Scrape type for CU35051: 1
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_a8770f0515bbd0337cbad0a1b71456b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_a8770f0515bbd0337cbad0a1b71456b8.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_5950b13ab38ab0f7a2570fcf9a01a651.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_5950b13ab38ab0f7a2570fcf9a01a651.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_cc7b524ade07b6ef2d5c3dcb0b36e533.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_cc7b524ade07b6ef2d5c3dcb0b36e533.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_9d650a26f5eefceb34293acd42e2bd6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_9d650a26f5eefceb34293acd42e2bd6c.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_3ce8b1d484257fc020b79d8079300848.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_3ce8b1d484257fc020b79d8079300848.jpg not downloaded yet
2026-03-28 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_f215bc5bd262a249d17becf72e372c56.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_c3efe0491d26de683f711211db445a01.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04a3510>
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_7b3c8a0d551fed85ae6577adf3d656ce.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_7b3c8a0d551fed85ae6577adf3d656ce.jpg saved to cache
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13adcd0>
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_c414c0624c4efdcd800d2d3f2a27b6ee.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c414c0624c4efdcd800d2d3f2a27b6ee.jpg saved to cache
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9
2026-03-28 11:35:26 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-28 11:35:26 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [auto1.be] INFO: Scrape type for PK02246: 1
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_ae2bdf8f027e3532d07d3ea505a1f506.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_ae2bdf8f027e3532d07d3ea505a1f506.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_994fbf75cfd338ef34dc3f0c97c3c528.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_994fbf75cfd338ef34dc3f0c97c3c528.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_1696c827b514b0734d19c8b229257e57.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_1696c827b514b0734d19c8b229257e57.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_0c55ce07edf63bda31144cc5289110c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0c55ce07edf63bda31144cc5289110c6.jpg not downloaded yet
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_04d9523e2a82d09f5b8161722065f646.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_04d9523e2a82d09f5b8161722065f646.jpg not downloaded yet
2026-03-28 11:35:26 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-28 11:35:26 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for LY17098: 1
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_fdb6dbd662288144e7342bded67edc96.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_fdb6dbd662288144e7342bded67edc96.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_548683929f7e154f5272a8853ec67106.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_548683929f7e154f5272a8853ec67106.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_27f302049d8e387fb7ea5a6f441e6b95.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_27f302049d8e387fb7ea5a6f441e6b95.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_92f1ed5eee7b43c4f595c43ce86e1a6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_92f1ed5eee7b43c4f595c43ce86e1a6c.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_fb028444bd72f2b72dc481be2346ba08.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_fb028444bd72f2b72dc481be2346ba08.jpg not downloaded yet
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04c9210>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_977096f547dc54ecd6489b1dae74e478.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_977096f547dc54ecd6489b1dae74e478.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad137d48-5892-529d-9804-3a64ab9edc12
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_55554ce99ce3e70fd916f2b42120dfab.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for FC78029: 1
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_c794ea5493b368c470c0750ff3ff14e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_c794ea5493b368c470c0750ff3ff14e5.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_746e4362f8e1bc922b3d58d565b1daf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_746e4362f8e1bc922b3d58d565b1daf1.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_28af27dbb9739ed04f98c36342ed57c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_28af27dbb9739ed04f98c36342ed57c1.jpg not downloaded yet
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN37182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04dddd0>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_f215bc5bd262a249d17becf72e372c56.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_f215bc5bd262a249d17becf72e372c56.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad137d48-5892-529d-9804-3a64ab9edc12
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13be490>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_c3efe0491d26de683f711211db445a01.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_c3efe0491d26de683f711211db445a01.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad137d48-5892-529d-9804-3a64ab9edc12
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_6924b93cc7a323899e67e15d4f74f59e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_37c7c162397c9bf214080f2a550969fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for EH00335: 1
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_668594f6f9942e54183a8d0a7533bea6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_668594f6f9942e54183a8d0a7533bea6.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_7a4936f27c50b3c5299e9714e689e88e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_7a4936f27c50b3c5299e9714e689e88e.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_cbb7c299487ded2ceabad530894ccf81.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_cbb7c299487ded2ceabad530894ccf81.jpg not downloaded yet
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04bb690>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_55554ce99ce3e70fd916f2b42120dfab.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_55554ce99ce3e70fd916f2b42120dfab.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for WH49963: 1
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_6a71bea94e8785186f55a0544bf2a9ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_6a71bea94e8785186f55a0544bf2a9ea.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_0e42a74f27b01b1803b00307edbb98f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0e42a74f27b01b1803b00307edbb98f4.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_25a459a42ab69e684fbf9c8e4fa2dd15.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_25a459a42ab69e684fbf9c8e4fa2dd15.jpg not downloaded yet
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS76018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_de47c25103dab53b5b2db2ffb3da2e10.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for KL53758: 1
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_30c53cd820ea31b88d0d35cce62cd003.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_30c53cd820ea31b88d0d35cce62cd003.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_787db6f3eaaa8ce6f4e7d58ea9188056.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_787db6f3eaaa8ce6f4e7d58ea9188056.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_613968b1444d533ce924116670c06f67.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_613968b1444d533ce924116670c06f67.jpg not downloaded yet
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04b63d0>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_6924b93cc7a323899e67e15d4f74f59e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_6924b93cc7a323899e67e15d4f74f59e.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e433a844-a689-5367-8714-653fee095003
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14ead90>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_37c7c162397c9bf214080f2a550969fe.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_37c7c162397c9bf214080f2a550969fe.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_b8a30f24238cafbae2abbee0af2d814f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_041afe7357bffc492bfdd5d77e0e74b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_06629df8ef2707f5120b65e41b0dc5bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for RA73981: 1
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_429f44d5138cafb56145e2a9725e3f72.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_429f44d5138cafb56145e2a9725e3f72.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_da1382b9fd0ba3986b0e32b1addb8845.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_da1382b9fd0ba3986b0e32b1addb8845.jpg not downloaded yet
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_d502cc6152b2a1908ff2b191194d81d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_d502cc6152b2a1908ff2b191194d81d3.jpg not downloaded yet
2026-03-28 11:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for EJ96142: 1
2026-03-28 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_6cd3088c10c78219162e7c5ec1b82281.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd43628d0>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_de47c25103dab53b5b2db2ffb3da2e10.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_de47c25103dab53b5b2db2ffb3da2e10.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:27 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-28 11:35:27 [auto1.be] INFO: Scrape type for HE39793: 1
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd090d1d0>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_b8a30f24238cafbae2abbee0af2d814f.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_b8a30f24238cafbae2abbee0af2d814f.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a232d0>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_041afe7357bffc492bfdd5d77e0e74b5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_041afe7357bffc492bfdd5d77e0e74b5.jpg saved to cache
2026-03-28 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04e5bd0>
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_06629df8ef2707f5120b65e41b0dc5bc.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_06629df8ef2707f5120b65e41b0dc5bc.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_f50d2468ec517321920f4b5cc12dfb24.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_f7650332f0b423fe79bccab03967fa4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-28 11:35:28 [auto1.be] INFO: Scrape type for DD83263: 1
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_92f1ed5eee7b43c4f595c43ce86e1a6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_fb028444bd72f2b72dc481be2346ba08.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_27f302049d8e387fb7ea5a6f441e6b95.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-28 11:35:28 [auto1.be] INFO: Scrape type for SW21472: 1
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET88330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a21390>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_6cd3088c10c78219162e7c5ec1b82281.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_6cd3088c10c78219162e7c5ec1b82281.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d889dad9ade14ee2c31df0c4112647fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-28 11:35:28 [auto1.be] INFO: Scrape type for EY57880: 1
2026-03-28 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_548683929f7e154f5272a8853ec67106.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_25a459a42ab69e684fbf9c8e4fa2dd15.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-28 11:35:28 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_d7d7728627e7ae3a5caadf428faf11cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09b8910>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_f50d2468ec517321920f4b5cc12dfb24.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_f50d2468ec517321920f4b5cc12dfb24.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14317d0>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_f7650332f0b423fe79bccab03967fa4b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_f7650332f0b423fe79bccab03967fa4b.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd156a490>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_92f1ed5eee7b43c4f595c43ce86e1a6c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_92f1ed5eee7b43c4f595c43ce86e1a6c.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0aa71d0>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_fb028444bd72f2b72dc481be2346ba08.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_fb028444bd72f2b72dc481be2346ba08.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ec510>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_27f302049d8e387fb7ea5a6f441e6b95.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_27f302049d8e387fb7ea5a6f441e6b95.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_613968b1444d533ce924116670c06f67.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13ca250>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_d889dad9ade14ee2c31df0c4112647fd.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d889dad9ade14ee2c31df0c4112647fd.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09b6790>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_548683929f7e154f5272a8853ec67106.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_548683929f7e154f5272a8853ec67106.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1433910>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_25a459a42ab69e684fbf9c8e4fa2dd15.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_25a459a42ab69e684fbf9c8e4fa2dd15.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14330d0>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_d7d7728627e7ae3a5caadf428faf11cf.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_d7d7728627e7ae3a5caadf428faf11cf.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_da1382b9fd0ba3986b0e32b1addb8845.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_429f44d5138cafb56145e2a9725e3f72.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14f0050>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_613968b1444d533ce924116670c06f67.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_613968b1444d533ce924116670c06f67.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_f43198339518df5130b1101a41d085bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_787db6f3eaaa8ce6f4e7d58ea9188056.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a2ca50>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_da1382b9fd0ba3986b0e32b1addb8845.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_da1382b9fd0ba3986b0e32b1addb8845.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_6a71bea94e8785186f55a0544bf2a9ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_30c53cd820ea31b88d0d35cce62cd003.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04dc2d0>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_429f44d5138cafb56145e2a9725e3f72.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_429f44d5138cafb56145e2a9725e3f72.jpg saved to cache
2026-03-28 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04a7750>
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_f43198339518df5130b1101a41d085bb.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_f43198339518df5130b1101a41d085bb.jpg saved to cache
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd146ab10>
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_787db6f3eaaa8ce6f4e7d58ea9188056.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_787db6f3eaaa8ce6f4e7d58ea9188056.jpg saved to cache
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN37182> (referer: https://www.auto1.com/v1/car-details-view/CN37182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_d502cc6152b2a1908ff2b191194d81d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a889d0>
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_6a71bea94e8785186f55a0544bf2a9ea.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_6a71bea94e8785186f55a0544bf2a9ea.jpg saved to cache
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a7c2d0>
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_30c53cd820ea31b88d0d35cce62cd003.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_30c53cd820ea31b88d0d35cce62cd003.jpg saved to cache
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ96142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0e42a74f27b01b1803b00307edbb98f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-28 11:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7d568-2372-53d1-9a2a-801a755fb75c with scrape type 1
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_38d1b83442b6860f643b45682a21621b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_38d1b83442b6860f643b45682a21621b.jpg not downloaded yet
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_668594f6f9942e54183a8d0a7533bea6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_4ca6036100ebc80e3c976c2b09c77089.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_4ca6036100ebc80e3c976c2b09c77089.jpg not downloaded yet
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS76018> (referer: https://www.auto1.com/v1/car-details-view/XS76018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE39793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_c794ea5493b368c470c0750ff3ff14e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_57c68de053c614fec07257fc013e9219.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_57c68de053c614fec07257fc013e9219.jpg not downloaded yet
2026-03-28 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13d05d0>
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_d502cc6152b2a1908ff2b191194d81d3.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_d502cc6152b2a1908ff2b191194d81d3.jpg saved to cache
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_0ead12cea377fb74784aad294e54bfac.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0ead12cea377fb74784aad294e54bfac.jpg not downloaded yet
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_7a4936f27c50b3c5299e9714e689e88e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_746e4362f8e1bc922b3d58d565b1daf1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_cbb7c299487ded2ceabad530894ccf81.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_b36ce9719ab7d74306664f3b5804027c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_b36ce9719ab7d74306664f3b5804027c.jpg not downloaded yet
2026-03-28 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW21472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09cfbd0>
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_0e42a74f27b01b1803b00307edbb98f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0e42a74f27b01b1803b00307edbb98f4.jpg saved to cache
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd139ec90>
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_668594f6f9942e54183a8d0a7533bea6.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_668594f6f9942e54183a8d0a7533bea6.jpg saved to cache
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-28 11:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a00c4bcf-7f42-5950-b0cd-015cfad5186e with scrape type 1
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a00c4bcf-7f42-5950-b0cd-015cfad5186e
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_3ab478f2405cc1faa47404b178404fde.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_3ab478f2405cc1faa47404b178404fde.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_858da05364aea988a1ad2eab463d4200.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_858da05364aea988a1ad2eab463d4200.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_737e76bea75ea6620d2eb41a1be25ee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_737e76bea75ea6620d2eb41a1be25ee2.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_c707d063d56aed4c3466ee8fbfb9c6d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_c707d063d56aed4c3466ee8fbfb9c6d2.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_fa9c50b3eed9a31410341b9556514946.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_fa9c50b3eed9a31410341b9556514946.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_96ba7f62687c1616dddd9121614cc4f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_96ba7f62687c1616dddd9121614cc4f0.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_c48973422348af51247691951708cf83.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_c48973422348af51247691951708cf83.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_1728fa94339abc1fb04e6359ca3f4799.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_1728fa94339abc1fb04e6359ca3f4799.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_ba813d8ba4b4a743e63d40ebcac4b916.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_ba813d8ba4b4a743e63d40ebcac4b916.jpg already downloaded
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F8b%252F3f8b3a2cbbdf492ed59a4165f755293a%252Fpa%252FXS76018_aad996369891306904eeba4d28fcf4ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_aad996369891306904eeba4d28fcf4ca.jpg already downloaded
2026-03-28 11:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a00c4bcf-7f42-5950-b0cd-015cfad5186e, identifier: XS76018
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a22310>
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_c794ea5493b368c470c0750ff3ff14e5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_c794ea5493b368c470c0750ff3ff14e5.jpg saved to cache
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_0705679c54a27154d3124a224fdebec0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0705679c54a27154d3124a224fdebec0.jpg not downloaded yet
2026-03-28 11:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-28 11:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-28 11:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018 to the API
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS76018>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:29:22Z',
 'fuel_type': 'petrol',
 'id': 'a00c4bcf-7f42-5950-b0cd-015cfad5186e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS76018',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 38521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_3ab478f2405cc1faa47404b178404fde.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_858da05364aea988a1ad2eab463d4200.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_737e76bea75ea6620d2eb41a1be25ee2.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_c707d063d56aed4c3466ee8fbfb9c6d2.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_fa9c50b3eed9a31410341b9556514946.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_96ba7f62687c1616dddd9121614cc4f0.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_c48973422348af51247691951708cf83.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_1728fa94339abc1fb04e6359ca3f4799.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_ba813d8ba4b4a743e63d40ebcac4b916.jpg',
                'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_aad996369891306904eeba4d28fcf4ca.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_3ab478f2405cc1faa47404b178404fde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_858da05364aea988a1ad2eab463d4200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_737e76bea75ea6620d2eb41a1be25ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_c707d063d56aed4c3466ee8fbfb9c6d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_fa9c50b3eed9a31410341b9556514946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_96ba7f62687c1616dddd9121614cc4f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_c48973422348af51247691951708cf83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_1728fa94339abc1fb04e6359ca3f4799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_ba813d8ba4b4a743e63d40ebcac4b916.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a00c4bcf-7f42-5950-b0cd-015cfad5186e/a00c4bcf-7f42-5950-b0cd-015cfad5186e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/8b/3f8b3a2cbbdf492ed59a4165f755293a/pa/XS76018_aad996369891306904eeba4d28fcf4ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-28 11:35:30 [auto1.be] INFO: Saving data for XS76018: {'created_time': 1774697730.689196, 'last_price_update_time': 1774697730.689211, 'auction_closing_time': 1774884562.0}
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS76018') HTTP/1.1" 204 0
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD83263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA73981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b6f810>
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_7a4936f27c50b3c5299e9714e689e88e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_7a4936f27c50b3c5299e9714e689e88e.jpg saved to cache
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08f9c90>
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_746e4362f8e1bc922b3d58d565b1daf1.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_746e4362f8e1bc922b3d58d565b1daf1.jpg saved to cache
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd139e490>
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_cbb7c299487ded2ceabad530894ccf81.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_cbb7c299487ded2ceabad530894ccf81.jpg saved to cache
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0ead12cea377fb74784aad294e54bfac.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_57c68de053c614fec07257fc013e9219.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_4ca6036100ebc80e3c976c2b09c77089.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_7d4177e9d8855d297633cac40b349ade.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7d4177e9d8855d297633cac40b349ade.jpg not downloaded yet
2026-03-28 11:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY57880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET88330> (referer: https://www.auto1.com/v1/car-details-view/ET88330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_fdb6dbd662288144e7342bded67edc96.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_ad079e8c0b77e0f84d219850c3aeaa4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_ad079e8c0b77e0f84d219850c3aeaa4a.jpg not downloaded yet
2026-03-28 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_32646c84a8c5fffe6db5d8b8ac5fe9e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_32646c84a8c5fffe6db5d8b8ac5fe9e8.jpg not downloaded yet
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_7ad365aeeab96c9213bd7966cac62989.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7ad365aeeab96c9213bd7966cac62989.jpg not downloaded yet
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_b36ce9719ab7d74306664f3b5804027c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0705679c54a27154d3124a224fdebec0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0930dd0>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_0ead12cea377fb74784aad294e54bfac.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0ead12cea377fb74784aad294e54bfac.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0931ed0>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_57c68de053c614fec07257fc013e9219.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_57c68de053c614fec07257fc013e9219.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_1696c827b514b0734d19c8b229257e57.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7ad365aeeab96c9213bd7966cac62989.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a7cf90>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_4ca6036100ebc80e3c976c2b09c77089.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_4ca6036100ebc80e3c976c2b09c77089.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_994fbf75cfd338ef34dc3f0c97c3c528.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-28 11:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3911d70-a36f-595b-859c-a5e9fd60ea09 with scrape type 1
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_25c366a69d30404151f23a65474ea1d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_25c366a69d30404151f23a65474ea1d9.jpg not downloaded yet
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b51450>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_fdb6dbd662288144e7342bded67edc96.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_fdb6dbd662288144e7342bded67edc96.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13f2e90>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_b36ce9719ab7d74306664f3b5804027c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_b36ce9719ab7d74306664f3b5804027c.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd32d8ad0>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_0705679c54a27154d3124a224fdebec0.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0705679c54a27154d3124a224fdebec0.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_32646c84a8c5fffe6db5d8b8ac5fe9e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_ddbd4d9a1153e8719ce15bc311413830.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_ddbd4d9a1153e8719ce15bc311413830.jpg not downloaded yet
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_ae2bdf8f027e3532d07d3ea505a1f506.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a45690>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_1696c827b514b0734d19c8b229257e57.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_1696c827b514b0734d19c8b229257e57.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a32e50>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_7ad365aeeab96c9213bd7966cac62989.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7ad365aeeab96c9213bd7966cac62989.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08f9390>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_994fbf75cfd338ef34dc3f0c97c3c528.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_994fbf75cfd338ef34dc3f0c97c3c528.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_28af27dbb9739ed04f98c36342ed57c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_aa73f0577dc229d7ca00c67a1359b8c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_aa73f0577dc229d7ca00c67a1359b8c1.jpg not downloaded yet
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_ad079e8c0b77e0f84d219850c3aeaa4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH49963/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_2633a3fc15aed0f5e5c0f99b86d96ee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_2633a3fc15aed0f5e5c0f99b86d96ee2.jpg not downloaded yet
2026-03-28 11:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13bdad0>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_32646c84a8c5fffe6db5d8b8ac5fe9e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_32646c84a8c5fffe6db5d8b8ac5fe9e8.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13e9290>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_ae2bdf8f027e3532d07d3ea505a1f506.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_ae2bdf8f027e3532d07d3ea505a1f506.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_38d1b83442b6860f643b45682a21621b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_18c14ae3e3dc367e4925f128a157061a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_18c14ae3e3dc367e4925f128a157061a.jpg not downloaded yet
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_25c366a69d30404151f23a65474ea1d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH00335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09fa1d0>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_28af27dbb9739ed04f98c36342ed57c1.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_28af27dbb9739ed04f98c36342ed57c1.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ad2810>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_ad079e8c0b77e0f84d219850c3aeaa4a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_ad079e8c0b77e0f84d219850c3aeaa4a.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_d85edb3e64fb34913b17f4beea9da9f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_d85edb3e64fb34913b17f4beea9da9f5.jpg not downloaded yet
2026-03-28 11:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_ddbd4d9a1153e8719ce15bc311413830.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_aa73f0577dc229d7ca00c67a1359b8c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_03bdcd71b0fa1213af9bd2e5e87b60f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_03bdcd71b0fa1213af9bd2e5e87b60f4.jpg not downloaded yet
2026-03-28 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL53758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09ea750>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_38d1b83442b6860f643b45682a21621b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_38d1b83442b6860f643b45682a21621b.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13c9750>
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_25c366a69d30404151f23a65474ea1d9.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_25c366a69d30404151f23a65474ea1d9.jpg saved to cache
2026-03-28 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_852c39c4bc8990a9d635ba19006c16b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_852c39c4bc8990a9d635ba19006c16b5.jpg not downloaded yet
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC78029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE39793> (referer: https://www.auto1.com/v1/car-details-view/HE39793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a1f850>
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_ddbd4d9a1153e8719ce15bc311413830.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_ddbd4d9a1153e8719ce15bc311413830.jpg saved to cache
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a1bd50>
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_aa73f0577dc229d7ca00c67a1359b8c1.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_aa73f0577dc229d7ca00c67a1359b8c1.jpg saved to cache
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_185c8ae4ed714371d0ba697705a985aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_185c8ae4ed714371d0ba697705a985aa.jpg not downloaded yet
2026-03-28 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7d4177e9d8855d297633cac40b349ade.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_2633a3fc15aed0f5e5c0f99b86d96ee2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_5086b594a08b7e155aa3076dafd0fc78.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_5086b594a08b7e155aa3076dafd0fc78.jpg not downloaded yet
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY17098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-28 11:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504aed41-bf6e-5884-9e2f-adf46851589d with scrape type 1
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_05a306a34e37dbf9c609d0611b2710d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_05a306a34e37dbf9c609d0611b2710d7.jpg not downloaded yet
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_18c14ae3e3dc367e4925f128a157061a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_d85edb3e64fb34913b17f4beea9da9f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_649a3c6d7be0faadf1264b2e5e0ea7ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_649a3c6d7be0faadf1264b2e5e0ea7ab.jpg not downloaded yet
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_fdba9db56b4147fbad4b18288b87fa23.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_fdba9db56b4147fbad4b18288b87fa23.jpg not downloaded yet
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0c55ce07edf63bda31144cc5289110c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ96142> (referer: https://www.auto1.com/v1/car-details-view/EJ96142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_ccbfe857d2c7f9e2e95f4b0f5aa22b57.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_ccbfe857d2c7f9e2e95f4b0f5aa22b57.jpg not downloaded yet
2026-03-28 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_907fbdf616daeaabed862daa73c5a26a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_907fbdf616daeaabed862daa73c5a26a.jpg not downloaded yet
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08a4e50>
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F1f%252Fb71fe68fecea744636f730c795b06df7%252Fpa%252FCN37182_7d4177e9d8855d297633cac40b349ade.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7d4177e9d8855d297633cac40b349ade.jpg saved to cache
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ee7d568-2372-53d1-9a2a-801a755fb75c
2026-03-28 11:35:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ee7d568-2372-53d1-9a2a-801a755fb75c, skipping ID generation
2026-03-28 11:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7d568-2372-53d1-9a2a-801a755fb75c with scrape type 1
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ee7d568-2372-53d1-9a2a-801a755fb75c sending to next pipeline
2026-03-28 11:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ee7d568-2372-53d1-9a2a-801a755fb75c, identifier: CN37182
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ab7690>
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_2633a3fc15aed0f5e5c0f99b86d96ee2.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_2633a3fc15aed0f5e5c0f99b86d96ee2.jpg saved to cache
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_852c39c4bc8990a9d635ba19006c16b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_1f786fa9a48324b10bdd6eb800d42f6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_1f786fa9a48324b10bdd6eb800d42f6b.jpg not downloaded yet
2026-03-28 11:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-28 11:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-28 11:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182 to the API
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7d4177e9d8855d297633cac40b349ade.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:32:54Z',
 'fuel_type': 'diesel',
 'id': '7ee7d568-2372-53d1-9a2a-801a755fb75c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN37182',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 60189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_38d1b83442b6860f643b45682a21621b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_4ca6036100ebc80e3c976c2b09c77089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_57c68de053c614fec07257fc013e9219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0ead12cea377fb74784aad294e54bfac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_b36ce9719ab7d74306664f3b5804027c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_0705679c54a27154d3124a224fdebec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7d4177e9d8855d297633cac40b349ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_ad079e8c0b77e0f84d219850c3aeaa4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_32646c84a8c5fffe6db5d8b8ac5fe9e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7d568-2372-53d1-9a2a-801a755fb75c/7ee7d568-2372-53d1-9a2a-801a755fb75c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/1f/b71fe68fecea744636f730c795b06df7/pa/CN37182_7ad365aeeab96c9213bd7966cac62989.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L2H1 2,9t Formula Edition',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Formula Edition',
 'year': 2017}
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-28 11:35:32 [auto1.be] INFO: Saving data for CN37182: {'created_time': 1774697732.981308, 'last_price_update_time': 1774697732.981318, 'auction_closing_time': 1774884774.0}
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN37182') HTTP/1.1" 204 0
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_03bdcd71b0fa1213af9bd2e5e87b60f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_5086b594a08b7e155aa3076dafd0fc78.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_04d9523e2a82d09f5b8161722065f646.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_fdba9db56b4147fbad4b18288b87fa23.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_44e8ccf1d19b8c02f327b71df22b0e96.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_44e8ccf1d19b8c02f327b71df22b0e96.jpg not downloaded yet
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA73981> (referer: https://www.auto1.com/v1/car-details-view/RA73981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD83263> (referer: https://www.auto1.com/v1/car-details-view/DD83263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY57880> (referer: https://www.auto1.com/v1/car-details-view/EY57880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1451210>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_18c14ae3e3dc367e4925f128a157061a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_18c14ae3e3dc367e4925f128a157061a.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd047acd0>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_d85edb3e64fb34913b17f4beea9da9f5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_d85edb3e64fb34913b17f4beea9da9f5.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d1ed0>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_0c55ce07edf63bda31144cc5289110c6.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0c55ce07edf63bda31144cc5289110c6.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-28 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb779073-baaf-5e6e-a125-614e69685435 with scrape type 1
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_86d59875a6b0d81e486308278c1c6330.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_86d59875a6b0d81e486308278c1c6330.jpg not downloaded yet
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a23f90>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_852c39c4bc8990a9d635ba19006c16b5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_852c39c4bc8990a9d635ba19006c16b5.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_5c77f35fa0cf1ea35c6ee53fe7b76b45.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_5c77f35fa0cf1ea35c6ee53fe7b76b45.jpg not downloaded yet
2026-03-28 11:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_c72edfc91b9aaf32ba0da7be021eda9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_c72edfc91b9aaf32ba0da7be021eda9d.jpg not downloaded yet
2026-03-28 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_185c8ae4ed714371d0ba697705a985aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_e78dd7d0400c642068853952a207c2d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_e78dd7d0400c642068853952a207c2d4.jpg not downloaded yet
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_d7d61b5f40b0a93f9e1198bee604cead.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_d7d61b5f40b0a93f9e1198bee604cead.jpg not downloaded yet
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_4152777952c9fc2dc9c071ce1f302f9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_4152777952c9fc2dc9c071ce1f302f9e.jpg not downloaded yet
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04985d0>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_03bdcd71b0fa1213af9bd2e5e87b60f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_03bdcd71b0fa1213af9bd2e5e87b60f4.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08e5910>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_5086b594a08b7e155aa3076dafd0fc78.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_5086b594a08b7e155aa3076dafd0fc78.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0487d90>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_04d9523e2a82d09f5b8161722065f646.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_04d9523e2a82d09f5b8161722065f646.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09bbd10>
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_fdba9db56b4147fbad4b18288b87fa23.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_fdba9db56b4147fbad4b18288b87fa23.jpg saved to cache
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-28 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with scrape type 1
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4c9c6e8a-198e-5a44-af19-4d58da22fa0c
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fa0%252Faea042f30a9d0dabd560a06b5cd05b9d%252Fpa%252FRA73981_909912a7be63ec23f3ea2dc19d058631.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_909912a7be63ec23f3ea2dc19d058631.jpg already downloaded
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fa0%252Faea042f30a9d0dabd560a06b5cd05b9d%252Fpa%252FRA73981_f40dfda9ccd80fcaca0de9bab0b36109.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_f40dfda9ccd80fcaca0de9bab0b36109.jpg already downloaded
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fa0%252Faea042f30a9d0dabd560a06b5cd05b9d%252Fpa%252FRA73981_9e839a9923095ad50f0dab116e0fccc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_9e839a9923095ad50f0dab116e0fccc1.jpg already downloaded
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fa0%252Faea042f30a9d0dabd560a06b5cd05b9d%252Fpa%252FRA73981_816eddaf367345eb5a05a13b788b0b81.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_816eddaf367345eb5a05a13b788b0b81.jpg already downloaded
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fa0%252Faea042f30a9d0dabd560a06b5cd05b9d%252Fpa%252FRA73981_c6d78af2d85dcc34dbb8ee9314aab948.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_c6d78af2d85dcc34dbb8ee9314aab948.jpg already downloaded
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fa0%252Faea042f30a9d0dabd560a06b5cd05b9d%252Fpa%252FRA73981_7396d2e5fc69ad12dab60088264a2a62.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_7396d2e5fc69ad12dab60088264a2a62.jpg already downloaded
2026-03-28 11:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c, identifier: RA73981
2026-03-28 11:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-28 11:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32743c6-2b98-5c6e-87ba-bcd434b3cace with scrape type 1
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_735318ea8d4fdeed5af5fd336c4d8196.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_735318ea8d4fdeed5af5fd336c4d8196.jpg not downloaded yet
2026-03-28 11:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-28 11:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with scrape type 1
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_04bd89521695045372e06cbae169d65d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_04bd89521695045372e06cbae169d65d.jpg not downloaded yet
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_bcd791e10d98b7eb76cbfcaa53cf3f8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_bcd791e10d98b7eb76cbfcaa53cf3f8a.jpg not downloaded yet
2026-03-28 11:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK02246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-28 11:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981 to the API
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA73981>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:09:45Z',
 'fuel_type': 'diesel',
 'id': '4c9c6e8a-198e-5a44-af19-4d58da22fa0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA73981',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 282378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_909912a7be63ec23f3ea2dc19d058631.jpg',
                'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_f40dfda9ccd80fcaca0de9bab0b36109.jpg',
                'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_9e839a9923095ad50f0dab116e0fccc1.jpg',
                'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_816eddaf367345eb5a05a13b788b0b81.jpg',
                'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_c6d78af2d85dcc34dbb8ee9314aab948.jpg',
                'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_7396d2e5fc69ad12dab60088264a2a62.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9c6e8a-198e-5a44-af19-4d58da22fa0c/4c9c6e8a-198e-5a44-af19-4d58da22fa0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_909912a7be63ec23f3ea2dc19d058631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9c6e8a-198e-5a44-af19-4d58da22fa0c/4c9c6e8a-198e-5a44-af19-4d58da22fa0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_f40dfda9ccd80fcaca0de9bab0b36109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9c6e8a-198e-5a44-af19-4d58da22fa0c/4c9c6e8a-198e-5a44-af19-4d58da22fa0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_9e839a9923095ad50f0dab116e0fccc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9c6e8a-198e-5a44-af19-4d58da22fa0c/4c9c6e8a-198e-5a44-af19-4d58da22fa0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_816eddaf367345eb5a05a13b788b0b81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9c6e8a-198e-5a44-af19-4d58da22fa0c/4c9c6e8a-198e-5a44-af19-4d58da22fa0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_c6d78af2d85dcc34dbb8ee9314aab948.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c9c6e8a-198e-5a44-af19-4d58da22fa0c/4c9c6e8a-198e-5a44-af19-4d58da22fa0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/a0/aea042f30a9d0dabd560a06b5cd05b9d/pa/RA73981_7396d2e5fc69ad12dab60088264a2a62.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2008}
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-28 11:35:34 [auto1.be] INFO: Saving data for RA73981: {'created_time': 1774697734.637786, 'last_price_update_time': 1774697734.637795, 'auction_closing_time': 1774883385.0}
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA73981') HTTP/1.1" 204 0
2026-03-28 11:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_44e8ccf1d19b8c02f327b71df22b0e96.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_bddf3f12ef03889b678f25106efbdedf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_bddf3f12ef03889b678f25106efbdedf.jpg not downloaded yet
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_b7c3a7fac5cfc719b356695a3f5e22be.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b7c3a7fac5cfc719b356695a3f5e22be.jpg not downloaded yet
2026-03-28 11:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09b9290>
2026-03-28 11:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fb7%252F6db7de002af59fb9f62926f4e83d9c92%252Fpa%252FET88330_185c8ae4ed714371d0ba697705a985aa.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_185c8ae4ed714371d0ba697705a985aa.jpg saved to cache
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3911d70-a36f-595b-859c-a5e9fd60ea09
2026-03-28 11:35:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3911d70-a36f-595b-859c-a5e9fd60ea09, skipping ID generation
2026-03-28 11:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3911d70-a36f-595b-859c-a5e9fd60ea09 with scrape type 1
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3911d70-a36f-595b-859c-a5e9fd60ea09 sending to next pipeline
2026-03-28 11:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3911d70-a36f-595b-859c-a5e9fd60ea09, identifier: ET88330
2026-03-28 11:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_86d59875a6b0d81e486308278c1c6330.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_1f786fa9a48324b10bdd6eb800d42f6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_216df981deb045b99ed94926986bbcc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_216df981deb045b99ed94926986bbcc3.jpg not downloaded yet
2026-03-28 11:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH49963> (referer: https://www.auto1.com/v1/car-details-view/WH49963/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW21472> (referer: https://www.auto1.com/v1/car-details-view/SW21472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 11:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-28 11:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330 to the API
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_185c8ae4ed714371d0ba697705a985aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:49Z',
 'fuel_type': 'petrol',
 'id': 'e3911d70-a36f-595b-859c-a5e9fd60ea09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET88330',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 25368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_25c366a69d30404151f23a65474ea1d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_ddbd4d9a1153e8719ce15bc311413830.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_aa73f0577dc229d7ca00c67a1359b8c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_2633a3fc15aed0f5e5c0f99b86d96ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_18c14ae3e3dc367e4925f128a157061a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_d85edb3e64fb34913b17f4beea9da9f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_03bdcd71b0fa1213af9bd2e5e87b60f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_852c39c4bc8990a9d635ba19006c16b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_185c8ae4ed714371d0ba697705a985aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3911d70-a36f-595b-859c-a5e9fd60ea09/e3911d70-a36f-595b-859c-a5e9fd60ea09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/b7/6db7de002af59fb9f62926f4e83d9c92/pa/ET88330_5086b594a08b7e155aa3076dafd0fc78.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2010}
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [auto1.be] INFO: Saving data for ET88330: {'created_time': 1774697735.307143, 'last_price_update_time': 1774697735.307154, 'auction_closing_time': 1774883869.0}
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET88330') HTTP/1.1" 204 0
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_21fc355e73d612e3b674dcc5418d98bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_21fc355e73d612e3b674dcc5418d98bd.jpg not downloaded yet
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_a20aa4ecd45c9e57c486b0015e72aa1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_a20aa4ecd45c9e57c486b0015e72aa1e.jpg not downloaded yet
2026-03-28 11:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH00335> (referer: https://www.auto1.com/v1/car-details-view/EH00335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL53758> (referer: https://www.auto1.com/v1/car-details-view/KL53758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_cd4a068f412fa3eac353a1beca033517.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_cd4a068f412fa3eac353a1beca033517.jpg not downloaded yet
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04b6b50>
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_44e8ccf1d19b8c02f327b71df22b0e96.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_44e8ccf1d19b8c02f327b71df22b0e96.jpg saved to cache
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_5c77f35fa0cf1ea35c6ee53fe7b76b45.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_efd29e9a10e273904e9e044a4e3206fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_efd29e9a10e273904e9e044a4e3206fc.jpg not downloaded yet
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_baf845040bbddeb05e16af690400550e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_baf845040bbddeb05e16af690400550e.jpg not downloaded yet
2026-03-28 11:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_735318ea8d4fdeed5af5fd336c4d8196.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_04bd89521695045372e06cbae169d65d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_eb080527006476ee57ae9d02c862d30f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_eb080527006476ee57ae9d02c862d30f.jpg not downloaded yet
2026-03-28 11:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1386c10>
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_86d59875a6b0d81e486308278c1c6330.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_86d59875a6b0d81e486308278c1c6330.jpg saved to cache
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0912f50>
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_1f786fa9a48324b10bdd6eb800d42f6b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_1f786fa9a48324b10bdd6eb800d42f6b.jpg saved to cache
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-28 11:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3366934-d91c-5156-a369-650665629474 with scrape type 1
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_ee3490fba70b02cb4bc22bd259b69c2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_ee3490fba70b02cb4bc22bd259b69c2c.jpg not downloaded yet
2026-03-28 11:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-28 11:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e819c02d-4bb2-55db-8d4e-fce41dacd5cf with scrape type 1
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e819c02d-4bb2-55db-8d4e-fce41dacd5cf
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_0028512b750520f35f7ae5cdd4749101.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_0028512b750520f35f7ae5cdd4749101.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_a3efc849720f429856a976d9c72f22c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_a3efc849720f429856a976d9c72f22c3.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_ddc27d1b88b1f662d5c29b707ef048ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_ddc27d1b88b1f662d5c29b707ef048ac.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_517e0fa29b4744347601ae703e86d9e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_517e0fa29b4744347601ae703e86d9e2.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_44f72ade4f95dc29d34e7eca6c5adde1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_44f72ade4f95dc29d34e7eca6c5adde1.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_50aa0e71158d7ded1926ca8e9deff55c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_50aa0e71158d7ded1926ca8e9deff55c.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_35846a45070b6433371ee2731410a7a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_35846a45070b6433371ee2731410a7a2.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_78808930e38564d1ec2b1d63986dfed4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_78808930e38564d1ec2b1d63986dfed4.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_87034c4d024ae78ecc506cde388ac4b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_87034c4d024ae78ecc506cde388ac4b8.jpg already downloaded
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F4a%252F2c4aa44aee803a09209140c46bad6fd7%252Fpa%252FSW21472_453bba95871db6c92d62e6abbbcade22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_453bba95871db6c92d62e6abbbcade22.jpg already downloaded
2026-03-28 11:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e819c02d-4bb2-55db-8d4e-fce41dacd5cf, identifier: SW21472
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_2cd6c43c9741e6e33954b65c63832186.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2cd6c43c9741e6e33954b65c63832186.jpg not downloaded yet
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_6e13b6e9e60028bc1196df4ab8c2c1f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_6e13b6e9e60028bc1196df4ab8c2c1f3.jpg not downloaded yet
2026-03-28 11:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-28 11:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-28 11:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472 to the API
2026-03-28 11:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW21472>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:21:26Z',
 'fuel_type': 'petrol',
 'id': 'e819c02d-4bb2-55db-8d4e-fce41dacd5cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW21472',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 222777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_0028512b750520f35f7ae5cdd4749101.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_a3efc849720f429856a976d9c72f22c3.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_ddc27d1b88b1f662d5c29b707ef048ac.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_517e0fa29b4744347601ae703e86d9e2.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_44f72ade4f95dc29d34e7eca6c5adde1.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_50aa0e71158d7ded1926ca8e9deff55c.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_35846a45070b6433371ee2731410a7a2.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_78808930e38564d1ec2b1d63986dfed4.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_87034c4d024ae78ecc506cde388ac4b8.jpg',
                'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_453bba95871db6c92d62e6abbbcade22.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_0028512b750520f35f7ae5cdd4749101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_a3efc849720f429856a976d9c72f22c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_ddc27d1b88b1f662d5c29b707ef048ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_517e0fa29b4744347601ae703e86d9e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_44f72ade4f95dc29d34e7eca6c5adde1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_50aa0e71158d7ded1926ca8e9deff55c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_35846a45070b6433371ee2731410a7a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_78808930e38564d1ec2b1d63986dfed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_87034c4d024ae78ecc506cde388ac4b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e819c02d-4bb2-55db-8d4e-fce41dacd5cf/e819c02d-4bb2-55db-8d4e-fce41dacd5cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/4a/2c4aa44aee803a09209140c46bad6fd7/pa/SW21472_453bba95871db6c92d62e6abbbcade22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [auto1.be] INFO: Saving data for SW21472: {'created_time': 1774697736.187641, 'last_price_update_time': 1774697736.187651, 'auction_closing_time': 1774884086.0}
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW21472') HTTP/1.1" 204 0
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_a440b3738742868b9fb44dc54fc00195.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a440b3738742868b9fb44dc54fc00195.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_1b65a7d8ebf0db985e23dd888187aac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_1b65a7d8ebf0db985e23dd888187aac5.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_2e3dae534c2eb9ffd6804617a2cc0248.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2e3dae534c2eb9ffd6804617a2cc0248.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_af85997963a4dae7d21604a6e5e4b347.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_af85997963a4dae7d21604a6e5e4b347.jpg not downloaded yet
2026-03-28 11:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-28 11:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbfe6a6-a285-5ee5-bd85-8a3050595475 with scrape type 1
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cdbfe6a6-a285-5ee5-bd85-8a3050595475
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_a8535fe80ae782ad498697bc8a9daab9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_a8535fe80ae782ad498697bc8a9daab9.jpg not downloaded yet
2026-03-28 11:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-28 11:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with scrape type 1
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_f4df45a0753d8b0e01f8e68bb7ad1cf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_f4df45a0753d8b0e01f8e68bb7ad1cf7.jpg not downloaded yet
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14122d0>
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_5c77f35fa0cf1ea35c6ee53fe7b76b45.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_5c77f35fa0cf1ea35c6ee53fe7b76b45.jpg saved to cache
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b6af90>
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_735318ea8d4fdeed5af5fd336c4d8196.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_735318ea8d4fdeed5af5fd336c4d8196.jpg saved to cache
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd2190810>
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_04bd89521695045372e06cbae169d65d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_04bd89521695045372e06cbae169d65d.jpg saved to cache
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_216df981deb045b99ed94926986bbcc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_bcd791e10d98b7eb76cbfcaa53cf3f8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_4152777952c9fc2dc9c071ce1f302f9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_a333751b32dafa4f1c728c70f5624b62.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a333751b32dafa4f1c728c70f5624b62.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_5cb6c89423f8d5723e45634c74e9903c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5cb6c89423f8d5723e45634c74e9903c.jpg not downloaded yet
2026-03-28 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC78029> (referer: https://www.auto1.com/v1/car-details-view/FC78029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY17098> (referer: https://www.auto1.com/v1/car-details-view/LY17098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_561397cb8e063066c3a992179c3a361d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_561397cb8e063066c3a992179c3a361d.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_b0d25bea7f6e4fd1044bfa2b8a0db4a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b0d25bea7f6e4fd1044bfa2b8a0db4a8.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_053428d747fc11174287e5244f3f3fa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_053428d747fc11174287e5244f3f3fa6.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_01c7e2ec7611af2cee6708e66084c19d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_01c7e2ec7611af2cee6708e66084c19d.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_87d350cdb34fcfce055c32425b4de618.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_87d350cdb34fcfce055c32425b4de618.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_5f6f6d11b259df2902750964c7dfa584.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5f6f6d11b259df2902750964c7dfa584.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_f14f39c0d39695cd022202c1c65b15d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_f14f39c0d39695cd022202c1c65b15d8.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_1cc76bb7247c8638469e4cb9a20f36ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_1cc76bb7247c8638469e4cb9a20f36ff.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_5cb3aec8f51899c627cd9fde101a07df.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_5cb3aec8f51899c627cd9fde101a07df.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_18b11c358ceebb6effbef07d6fad8aa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_18b11c358ceebb6effbef07d6fad8aa2.jpg not downloaded yet
2026-03-28 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_d7d61b5f40b0a93f9e1198bee604cead.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_4901699ce5a0365aa849e422be6a5f03.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_4901699ce5a0365aa849e422be6a5f03.jpg not downloaded yet
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04cad10>
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_216df981deb045b99ed94926986bbcc3.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_216df981deb045b99ed94926986bbcc3.jpg saved to cache
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09e4310>
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_bcd791e10d98b7eb76cbfcaa53cf3f8a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_bcd791e10d98b7eb76cbfcaa53cf3f8a.jpg saved to cache
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1561b10>
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_4152777952c9fc2dc9c071ce1f302f9e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_4152777952c9fc2dc9c071ce1f302f9e.jpg saved to cache
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_8de8d3b3fd263ab25b0ce5c4b6e31ef1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_8de8d3b3fd263ab25b0ce5c4b6e31ef1.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_39c5ab09e363f2191b43d6fa09a30ef5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_39c5ab09e363f2191b43d6fa09a30ef5.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_c9d62ff1c0efa17ff8fba9713bc01ec2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c9d62ff1c0efa17ff8fba9713bc01ec2.jpg not downloaded yet
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_3d87121afb9794a6038158025150002d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3d87121afb9794a6038158025150002d.jpg not downloaded yet
2026-03-28 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_bddf3f12ef03889b678f25106efbdedf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_a7dfd24a9023b380168217466ff412b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_a7dfd24a9023b380168217466ff412b8.jpg not downloaded yet
2026-03-28 11:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-28 11:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c0a291-758d-505c-bbb5-f0981838f388 with scrape type 1
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78c0a291-758d-505c-bbb5-f0981838f388
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_37ea7a35af983a89aad9b26b21a36b55.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_37ea7a35af983a89aad9b26b21a36b55.jpg already downloaded
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_8a5cf3cf2b6930f145308273a043484b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_8a5cf3cf2b6930f145308273a043484b.jpg already downloaded
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_d1bd79a973408180ed4edd545cf4d5c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_d1bd79a973408180ed4edd545cf4d5c3.jpg already downloaded
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_70f2aac9a89c929fd23e4133fe23d65a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_70f2aac9a89c929fd23e4133fe23d65a.jpg already downloaded
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_e7883dac591e5053fa59d50334811d87.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_e7883dac591e5053fa59d50334811d87.jpg already downloaded
2026-03-28 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_4a1d205f783681bb7d65f1934267e263.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_4a1d205f783681bb7d65f1934267e263.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_78f1938d9ad28757777d523b4906dd3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_78f1938d9ad28757777d523b4906dd3b.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_fa96413b79483c685e98a0c2002c837f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_fa96413b79483c685e98a0c2002c837f.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_d7496c51a1ac8c460a7cc8eccabd13f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_d7496c51a1ac8c460a7cc8eccabd13f2.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F3f%252Fbb3f1411137695a92c81f33db1bb3ac2%252Fpa%252FFC78029_4c4f2d23c068fe6a58be06f6c3465f88.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_4c4f2d23c068fe6a58be06f6c3465f88.jpg already downloaded
2026-03-28 11:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78c0a291-758d-505c-bbb5-f0981838f388, identifier: FC78029
2026-03-28 11:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-28 11:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with scrape type 1
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F37%252F4237376113304e42d0c02f216727b7d0%252Fpa%252FLY17098_00eedb2e78d86008fc6a8e84e713cd60.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_00eedb2e78d86008fc6a8e84e713cd60.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F37%252F4237376113304e42d0c02f216727b7d0%252Fpa%252FLY17098_fe1aa990b4e5989493cfe081cc9c70f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_fe1aa990b4e5989493cfe081cc9c70f7.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F37%252F4237376113304e42d0c02f216727b7d0%252Fpa%252FLY17098_a19c2a36698db74d11c17df9ff72d5a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_a19c2a36698db74d11c17df9ff72d5a2.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F37%252F4237376113304e42d0c02f216727b7d0%252Fpa%252FLY17098_7c01f98825065345907258ceb46c56fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_7c01f98825065345907258ceb46c56fe.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F37%252F4237376113304e42d0c02f216727b7d0%252Fpa%252FLY17098_c3f08d7706dc83bf1cc2222d0fa4240f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_c3f08d7706dc83bf1cc2222d0fa4240f.jpg already downloaded
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F37%252F4237376113304e42d0c02f216727b7d0%252Fpa%252FLY17098_f1e3392e8bd52b22ad3a63d98b354879.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_f1e3392e8bd52b22ad3a63d98b354879.jpg already downloaded
2026-03-28 11:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5, identifier: LY17098
2026-03-28 11:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b7c3a7fac5cfc719b356695a3f5e22be.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_237a3aae125b71e459876ccbd6b3c901.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_237a3aae125b71e459876ccbd6b3c901.jpg not downloaded yet
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_c42eaf8b4983d4751528f89907bdd295.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_c42eaf8b4983d4751528f89907bdd295.jpg not downloaded yet
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_0de5ba4dc2d61d34452e7cbf9704391e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_0de5ba4dc2d61d34452e7cbf9704391e.jpg not downloaded yet
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_1521c1d484776278abce2dcc590a2b61.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_1521c1d484776278abce2dcc590a2b61.jpg not downloaded yet
2026-03-28 11:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-28 11:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-28 11:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029 to the API
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC78029>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:34:46Z',
 'fuel_type': 'petrol',
 'id': '78c0a291-758d-505c-bbb5-f0981838f388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC78029',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 132105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_37ea7a35af983a89aad9b26b21a36b55.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_8a5cf3cf2b6930f145308273a043484b.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_d1bd79a973408180ed4edd545cf4d5c3.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_70f2aac9a89c929fd23e4133fe23d65a.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_e7883dac591e5053fa59d50334811d87.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_4a1d205f783681bb7d65f1934267e263.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_78f1938d9ad28757777d523b4906dd3b.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_fa96413b79483c685e98a0c2002c837f.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_d7496c51a1ac8c460a7cc8eccabd13f2.jpg',
                'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_4c4f2d23c068fe6a58be06f6c3465f88.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_37ea7a35af983a89aad9b26b21a36b55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_8a5cf3cf2b6930f145308273a043484b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_d1bd79a973408180ed4edd545cf4d5c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_70f2aac9a89c929fd23e4133fe23d65a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_e7883dac591e5053fa59d50334811d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_4a1d205f783681bb7d65f1934267e263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_78f1938d9ad28757777d523b4906dd3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_fa96413b79483c685e98a0c2002c837f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_d7496c51a1ac8c460a7cc8eccabd13f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c0a291-758d-505c-bbb5-f0981838f388/78c0a291-758d-505c-bbb5-f0981838f388_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/3f/bb3f1411137695a92c81f33db1bb3ac2/pa/FC78029_4c4f2d23c068fe6a58be06f6c3465f88.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2014}
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-28 11:35:37 [auto1.be] INFO: Saving data for FC78029: {'created_time': 1774697737.764261, 'last_price_update_time': 1774697737.764272, 'auction_closing_time': 1774884886.0}
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC78029') HTTP/1.1" 204 0
2026-03-28 11:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-28 11:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-28 11:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098 to the API
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY17098>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:34:08Z',
 'fuel_type': 'petrol',
 'id': '3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY17098',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 194581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_00eedb2e78d86008fc6a8e84e713cd60.jpg',
                'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_fe1aa990b4e5989493cfe081cc9c70f7.jpg',
                'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_a19c2a36698db74d11c17df9ff72d5a2.jpg',
                'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_7c01f98825065345907258ceb46c56fe.jpg',
                'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_c3f08d7706dc83bf1cc2222d0fa4240f.jpg',
                'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_f1e3392e8bd52b22ad3a63d98b354879.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5/3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_00eedb2e78d86008fc6a8e84e713cd60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5/3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_fe1aa990b4e5989493cfe081cc9c70f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5/3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_a19c2a36698db74d11c17df9ff72d5a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5/3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_7c01f98825065345907258ceb46c56fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5/3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_c3f08d7706dc83bf1cc2222d0fa4240f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5/3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/37/4237376113304e42d0c02f216727b7d0/pa/LY17098_f1e3392e8bd52b22ad3a63d98b354879.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Carens 1.6 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2009}
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [auto1.be] INFO: Saving data for LY17098: {'created_time': 1774697738.073627, 'last_price_update_time': 1774697738.073638, 'auction_closing_time': 1774884848.0}
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY17098') HTTP/1.1" 204 0
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_cd4a068f412fa3eac353a1beca033517.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_6565ad9d4ee4d2db86fc26d0ca9d212b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_6565ad9d4ee4d2db86fc26d0ca9d212b.jpg not downloaded yet
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_c70b3d40e87db9592d24da0625bae740.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c70b3d40e87db9592d24da0625bae740.jpg not downloaded yet
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_557f5fdcfa7f324cd2e050fdb2d136cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_557f5fdcfa7f324cd2e050fdb2d136cf.jpg not downloaded yet
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b357d0>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_d7d61b5f40b0a93f9e1198bee604cead.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_d7d61b5f40b0a93f9e1198bee604cead.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08c7490>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_bddf3f12ef03889b678f25106efbdedf.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_bddf3f12ef03889b678f25106efbdedf.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_a20aa4ecd45c9e57c486b0015e72aa1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_93612258b419f3b36d1a1d11d691599a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_93612258b419f3b36d1a1d11d691599a.jpg not downloaded yet
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_34247ba79e580aaf7d45ba63b9367dda.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_34247ba79e580aaf7d45ba63b9367dda.jpg not downloaded yet
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1473610>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_b7c3a7fac5cfc719b356695a3f5e22be.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b7c3a7fac5cfc719b356695a3f5e22be.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_8a444e9d54a809c4b6d1ee1d44f935fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_8a444e9d54a809c4b6d1ee1d44f935fa.jpg not downloaded yet
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_5c9fae8c7afc17cceb1a496bad5622ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_5c9fae8c7afc17cceb1a496bad5622ca.jpg not downloaded yet
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_1b65a7d8ebf0db985e23dd888187aac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a440b3738742868b9fb44dc54fc00195.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_dd2aa3b55e29c28152db65ecdc074da7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_dd2aa3b55e29c28152db65ecdc074da7.jpg not downloaded yet
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1453d50>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_cd4a068f412fa3eac353a1beca033517.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_cd4a068f412fa3eac353a1beca033517.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_3f9747e05c4740e8a2f01cff0dc75199.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3f9747e05c4740e8a2f01cff0dc75199.jpg not downloaded yet
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_fae19dd406eeb5010260851064ea4188.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_fae19dd406eeb5010260851064ea4188.jpg not downloaded yet
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd090c410>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_a20aa4ecd45c9e57c486b0015e72aa1e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_a20aa4ecd45c9e57c486b0015e72aa1e.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_a8535fe80ae782ad498697bc8a9daab9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_f4df45a0753d8b0e01f8e68bb7ad1cf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13bc550>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_1b65a7d8ebf0db985e23dd888187aac5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_1b65a7d8ebf0db985e23dd888187aac5.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14525d0>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_a440b3738742868b9fb44dc54fc00195.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a440b3738742868b9fb44dc54fc00195.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_6e13b6e9e60028bc1196df4ab8c2c1f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_05a306a34e37dbf9c609d0611b2710d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_649a3c6d7be0faadf1264b2e5e0ea7ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_ccbfe857d2c7f9e2e95f4b0f5aa22b57.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_3ce8b1d484257fc020b79d8079300848.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_907fbdf616daeaabed862daa73c5a26a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd153ea90>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_a8535fe80ae782ad498697bc8a9daab9.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_a8535fe80ae782ad498697bc8a9daab9.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdbfe6a6-a285-5ee5-bd85-8a3050595475
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_34247ba79e580aaf7d45ba63b9367dda.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_8a444e9d54a809c4b6d1ee1d44f935fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0900d10>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_f4df45a0753d8b0e01f8e68bb7ad1cf7.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_f4df45a0753d8b0e01f8e68bb7ad1cf7.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a10c50>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_6e13b6e9e60028bc1196df4ab8c2c1f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_6e13b6e9e60028bc1196df4ab8c2c1f3.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09ea710>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_05a306a34e37dbf9c609d0611b2710d7.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_05a306a34e37dbf9c609d0611b2710d7.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1554090>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_649a3c6d7be0faadf1264b2e5e0ea7ab.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_649a3c6d7be0faadf1264b2e5e0ea7ab.jpg saved to cache
2026-03-28 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09f18d0>
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_ccbfe857d2c7f9e2e95f4b0f5aa22b57.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_ccbfe857d2c7f9e2e95f4b0f5aa22b57.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ace4d0>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_3ce8b1d484257fc020b79d8079300848.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_3ce8b1d484257fc020b79d8079300848.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0915050>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_907fbdf616daeaabed862daa73c5a26a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_907fbdf616daeaabed862daa73c5a26a.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5f6f6d11b259df2902750964c7dfa584.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3d87121afb9794a6038158025150002d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_4901699ce5a0365aa849e422be6a5f03.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_dd2aa3b55e29c28152db65ecdc074da7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK02246> (referer: https://www.auto1.com/v1/car-details-view/PK02246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08eda10>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_34247ba79e580aaf7d45ba63b9367dda.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_34247ba79e580aaf7d45ba63b9367dda.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04e6d50>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_8a444e9d54a809c4b6d1ee1d44f935fa.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_8a444e9d54a809c4b6d1ee1d44f935fa.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a79650>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_5f6f6d11b259df2902750964c7dfa584.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5f6f6d11b259df2902750964c7dfa584.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09271d0>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_3d87121afb9794a6038158025150002d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3d87121afb9794a6038158025150002d.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1569150>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_4901699ce5a0365aa849e422be6a5f03.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_4901699ce5a0365aa849e422be6a5f03.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_93612258b419f3b36d1a1d11d691599a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_5c9fae8c7afc17cceb1a496bad5622ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c70b3d40e87db9592d24da0625bae740.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd3685810>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_dd2aa3b55e29c28152db65ecdc074da7.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_dd2aa3b55e29c28152db65ecdc074da7.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-28 11:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03849ee2-b597-56b3-a949-37d7f86bb163 with scrape type 1
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_10b1d66092eb801ecd47ec17e9e5e31c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_10b1d66092eb801ecd47ec17e9e5e31c.jpg not downloaded yet
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_fae19dd406eeb5010260851064ea4188.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_6565ad9d4ee4d2db86fc26d0ca9d212b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_800ec8b533a89d9d40581b015d0d61b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_800ec8b533a89d9d40581b015d0d61b1.jpg not downloaded yet
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_557f5fdcfa7f324cd2e050fdb2d136cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_1521c1d484776278abce2dcc590a2b61.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_d8d401b9415db88e4bb187c414637199.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d8d401b9415db88e4bb187c414637199.jpg not downloaded yet
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3f9747e05c4740e8a2f01cff0dc75199.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_d03f0e009c39e5f56c6483a4e0ce97cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d03f0e009c39e5f56c6483a4e0ce97cd.jpg not downloaded yet
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_0de5ba4dc2d61d34452e7cbf9704391e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04af110>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_93612258b419f3b36d1a1d11d691599a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_93612258b419f3b36d1a1d11d691599a.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14c6890>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_5c9fae8c7afc17cceb1a496bad5622ca.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_5c9fae8c7afc17cceb1a496bad5622ca.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14fcdd0>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_c70b3d40e87db9592d24da0625bae740.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c70b3d40e87db9592d24da0625bae740.jpg saved to cache
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdbfe6a6-a285-5ee5-bd85-8a3050595475
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c9d62ff1c0efa17ff8fba9713bc01ec2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_c722c9beb3490132da09e020aca946b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_c722c9beb3490132da09e020aca946b9.jpg not downloaded yet
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_c42eaf8b4983d4751528f89907bdd295.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_237a3aae125b71e459876ccbd6b3c901.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_a7dfd24a9023b380168217466ff412b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_39c5ab09e363f2191b43d6fa09a30ef5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_8de8d3b3fd263ab25b0ce5c4b6e31ef1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_722941126ef186d0f644e26b99d6be3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_722941126ef186d0f644e26b99d6be3c.jpg not downloaded yet
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_3bfe2f5cd10635eab55b8944950f16c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3bfe2f5cd10635eab55b8944950f16c1.jpg not downloaded yet
2026-03-28 11:35:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08969d0>
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_fae19dd406eeb5010260851064ea4188.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_fae19dd406eeb5010260851064ea4188.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13f5510>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_6565ad9d4ee4d2db86fc26d0ca9d212b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_6565ad9d4ee4d2db86fc26d0ca9d212b.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09e4590>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_557f5fdcfa7f324cd2e050fdb2d136cf.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_557f5fdcfa7f324cd2e050fdb2d136cf.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1410dd0>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_1521c1d484776278abce2dcc590a2b61.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_1521c1d484776278abce2dcc590a2b61.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0528690>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_3f9747e05c4740e8a2f01cff0dc75199.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3f9747e05c4740e8a2f01cff0dc75199.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1458cd0>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_0de5ba4dc2d61d34452e7cbf9704391e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_0de5ba4dc2d61d34452e7cbf9704391e.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdbfe6a6-a285-5ee5-bd85-8a3050595475
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_5cb3aec8f51899c627cd9fde101a07df.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_e21004229a001be603bf1b8e7b76ce34.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_e21004229a001be603bf1b8e7b76ce34.jpg not downloaded yet
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_1cc76bb7247c8638469e4cb9a20f36ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_10b1d66092eb801ecd47ec17e9e5e31c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_f14f39c0d39695cd022202c1c65b15d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_69c06715ddf8ba4fc8717a626d2a0b25.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_69c06715ddf8ba4fc8717a626d2a0b25.jpg not downloaded yet
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09e7ed0>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_c9d62ff1c0efa17ff8fba9713bc01ec2.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c9d62ff1c0efa17ff8fba9713bc01ec2.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdbfe6a6-a285-5ee5-bd85-8a3050595475
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b55c50>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_c42eaf8b4983d4751528f89907bdd295.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_c42eaf8b4983d4751528f89907bdd295.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13ad4d0>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_237a3aae125b71e459876ccbd6b3c901.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_237a3aae125b71e459876ccbd6b3c901.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd32c4f10>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_a7dfd24a9023b380168217466ff412b8.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_a7dfd24a9023b380168217466ff412b8.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09319d0>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_39c5ab09e363f2191b43d6fa09a30ef5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_39c5ab09e363f2191b43d6fa09a30ef5.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04bde10>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_8de8d3b3fd263ab25b0ce5c4b6e31ef1.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_8de8d3b3fd263ab25b0ce5c4b6e31ef1.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_3994bcd5dbab024fba86d47c64ff6e04.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3994bcd5dbab024fba86d47c64ff6e04.jpg not downloaded yet
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a61d50>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_5cb3aec8f51899c627cd9fde101a07df.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_5cb3aec8f51899c627cd9fde101a07df.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdbfe6a6-a285-5ee5-bd85-8a3050595475
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b6b950>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_1cc76bb7247c8638469e4cb9a20f36ff.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_1cc76bb7247c8638469e4cb9a20f36ff.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a0ce10>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_10b1d66092eb801ecd47ec17e9e5e31c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_10b1d66092eb801ecd47ec17e9e5e31c.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd150e5d0>
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_f14f39c0d39695cd022202c1c65b15d8.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_f14f39c0d39695cd022202c1c65b15d8.jpg saved to cache
2026-03-28 11:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_18b11c358ceebb6effbef07d6fad8aa2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_87d350cdb34fcfce055c32425b4de618.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d8d401b9415db88e4bb187c414637199.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_800ec8b533a89d9d40581b015d0d61b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_01c7e2ec7611af2cee6708e66084c19d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_053428d747fc11174287e5244f3f3fa6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3bfe2f5cd10635eab55b8944950f16c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_c722c9beb3490132da09e020aca946b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_722941126ef186d0f644e26b99d6be3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_af85997963a4dae7d21604a6e5e4b347.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04e8110>
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_18b11c358ceebb6effbef07d6fad8aa2.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_18b11c358ceebb6effbef07d6fad8aa2.jpg saved to cache
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_561397cb8e063066c3a992179c3a361d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2e3dae534c2eb9ffd6804617a2cc0248.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b0d25bea7f6e4fd1044bfa2b8a0db4a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a6ee90>
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_87d350cdb34fcfce055c32425b4de618.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_87d350cdb34fcfce055c32425b4de618.jpg saved to cache
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09fff90>
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_d8d401b9415db88e4bb187c414637199.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d8d401b9415db88e4bb187c414637199.jpg saved to cache
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a46f10>
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_800ec8b533a89d9d40581b015d0d61b1.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_800ec8b533a89d9d40581b015d0d61b1.jpg saved to cache
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13d1fd0>
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F20%252F9120871a444491984c221e9ae4c4f52b%252Fpa%252FKL53758_01c7e2ec7611af2cee6708e66084c19d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_01c7e2ec7611af2cee6708e66084c19d.jpg saved to cache
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868
2026-03-28 11:35:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868, skipping ID generation
2026-03-28 11:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with scrape type 1
2026-03-28 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 sending to next pipeline
2026-03-28 11:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868, identifier: KL53758
2026-03-28 11:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09bcc90>
2026-03-28 11:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0655ef6f9d90926dd3e9da2de71f4%252Fpa%252FEH00335_053428d747fc11174287e5244f3f3fa6.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_053428d747fc11174287e5244f3f3fa6.jpg saved to cache
2026-03-28 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdbfe6a6-a285-5ee5-bd85-8a3050595475
2026-03-28 11:35:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdbfe6a6-a285-5ee5-bd85-8a3050595475, skipping ID generation
2026-03-28 11:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbfe6a6-a285-5ee5-bd85-8a3050595475 with scrape type 1
2026-03-28 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdbfe6a6-a285-5ee5-bd85-8a3050595475 sending to next pipeline
2026-03-28 11:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cdbfe6a6-a285-5ee5-bd85-8a3050595475, identifier: EH00335
2026-03-28 11:35:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0985410>
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_3bfe2f5cd10635eab55b8944950f16c1.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3bfe2f5cd10635eab55b8944950f16c1.jpg saved to cache
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd32c6590>
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_c722c9beb3490132da09e020aca946b9.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_c722c9beb3490132da09e020aca946b9.jpg saved to cache
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08cd790>
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_722941126ef186d0f644e26b99d6be3c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_722941126ef186d0f644e26b99d6be3c.jpg saved to cache
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1453f10>
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_af85997963a4dae7d21604a6e5e4b347.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_af85997963a4dae7d21604a6e5e4b347.jpg saved to cache
2026-03-28 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-28 11:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-28 11:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758 to the API
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_01c7e2ec7611af2cee6708e66084c19d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'diesel',
 'id': 'cb2cc3eb-4d6f-5034-bb20-95c2a2a10868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53758',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 153835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_f4df45a0753d8b0e01f8e68bb7ad1cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_01c7e2ec7611af2cee6708e66084c19d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2695150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_18b11c358ceebb6effbef07d6fad8aa2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3d87121afb9794a6038158025150002d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2232508,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_1521c1d484776278abce2dcc590a2b61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_557f5fdcfa7f324cd2e050fdb2d136cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_34247ba79e580aaf7d45ba63b9367dda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_5c9fae8c7afc17cceb1a496bad5622ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_3f9747e05c4740e8a2f01cff0dc75199.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2cc3eb-4d6f-5034-bb20-95c2a2a10868/cb2cc3eb-4d6f-5034-bb20-95c2a2a10868_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2439269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/20/9120871a444491984c221e9ae4c4f52b/pa/KL53758_fae19dd406eeb5010260851064ea4188.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2016}
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-28 11:35:43 [auto1.be] INFO: Saving data for KL53758: {'created_time': 1774697743.73254, 'last_price_update_time': 1774697743.732555, 'auction_closing_time': 1774885961.0}
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KL53758') HTTP/1.1" 204 0
2026-03-28 11:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-28 11:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-28 11:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335 to the API
2026-03-28 11:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_053428d747fc11174287e5244f3f3fa6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:39Z',
 'fuel_type': 'diesel',
 'id': 'cdbfe6a6-a285-5ee5-bd85-8a3050595475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH00335',
 'listing': 'auction',
 'location': 'BE, Ardooie',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 197427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_a8535fe80ae782ad498697bc8a9daab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_053428d747fc11174287e5244f3f3fa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_5cb3aec8f51899c627cd9fde101a07df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c9d62ff1c0efa17ff8fba9713bc01ec2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_0de5ba4dc2d61d34452e7cbf9704391e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbfe6a6-a285-5ee5-bd85-8a3050595475/cdbfe6a6-a285-5ee5-bd85-8a3050595475_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0655ef6f9d90926dd3e9da2de71f4/pa/EH00335_c70b3d40e87db9592d24da0625bae740.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-28 11:35:44 [auto1.be] INFO: Saving data for EH00335: {'created_time': 1774697744.108818, 'last_price_update_time': 1774697744.108827, 'auction_closing_time': 1774884279.0}
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EH00335') HTTP/1.1" 204 0
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d03f0e009c39e5f56c6483a4e0ce97cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d1250>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_561397cb8e063066c3a992179c3a361d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_561397cb8e063066c3a992179c3a361d.jpg saved to cache
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09bf6d0>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_2e3dae534c2eb9ffd6804617a2cc0248.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2e3dae534c2eb9ffd6804617a2cc0248.jpg saved to cache
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b578d0>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_b0d25bea7f6e4fd1044bfa2b8a0db4a8.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b0d25bea7f6e4fd1044bfa2b8a0db4a8.jpg saved to cache
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1396850>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_d03f0e009c39e5f56c6483a4e0ce97cd.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d03f0e009c39e5f56c6483a4e0ce97cd.jpg saved to cache
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_ee3490fba70b02cb4bc22bd259b69c2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5cb6c89423f8d5723e45634c74e9903c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a333751b32dafa4f1c728c70f5624b62.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3994bcd5dbab024fba86d47c64ff6e04.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2cd6c43c9741e6e33954b65c63832186.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_efd29e9a10e273904e9e044a4e3206fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_e21004229a001be603bf1b8e7b76ce34.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_21fc355e73d612e3b674dcc5418d98bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_c72edfc91b9aaf32ba0da7be021eda9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_69c06715ddf8ba4fc8717a626d2a0b25.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_9d650a26f5eefceb34293acd42e2bd6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14ee450>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_ee3490fba70b02cb4bc22bd259b69c2c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_ee3490fba70b02cb4bc22bd259b69c2c.jpg saved to cache
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_cc7b524ade07b6ef2d5c3dcb0b36e533.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd090e3d0>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F05%252F72051fdf4b564e4299400d6f94fdb6b9%252Fpa%252FWH49963_5cb6c89423f8d5723e45634c74e9903c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5cb6c89423f8d5723e45634c74e9903c.jpg saved to cache
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3366934-d91c-5156-a369-650665629474
2026-03-28 11:35:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3366934-d91c-5156-a369-650665629474, skipping ID generation
2026-03-28 11:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3366934-d91c-5156-a369-650665629474 with scrape type 1
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3366934-d91c-5156-a369-650665629474 sending to next pipeline
2026-03-28 11:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3366934-d91c-5156-a369-650665629474, identifier: WH49963
2026-03-28 11:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1397150>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_a333751b32dafa4f1c728c70f5624b62.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a333751b32dafa4f1c728c70f5624b62.jpg saved to cache
2026-03-28 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09bff10>
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_3994bcd5dbab024fba86d47c64ff6e04.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3994bcd5dbab024fba86d47c64ff6e04.jpg saved to cache
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08ffb50>
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_2cd6c43c9741e6e33954b65c63832186.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2cd6c43c9741e6e33954b65c63832186.jpg saved to cache
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 11:35:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-28 11:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963 to the API
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5cb6c89423f8d5723e45634c74e9903c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:00:35Z',
 'fuel_type': 'hybrid',
 'id': 'a3366934-d91c-5156-a369-650665629474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH49963',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 76700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_ee3490fba70b02cb4bc22bd259b69c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_1b65a7d8ebf0db985e23dd888187aac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600145,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5cb6c89423f8d5723e45634c74e9903c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_5f6f6d11b259df2902750964c7dfa584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_4901699ce5a0365aa849e422be6a5f03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_a7dfd24a9023b380168217466ff412b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_6565ad9d4ee4d2db86fc26d0ca9d212b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_93612258b419f3b36d1a1d11d691599a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_8a444e9d54a809c4b6d1ee1d44f935fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3366934-d91c-5156-a369-650665629474/a3366934-d91c-5156-a369-650665629474_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/05/72051fdf4b564e4299400d6f94fdb6b9/pa/WH49963_dd2aa3b55e29c28152db65ecdc074da7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-28 11:35:45 [auto1.be] INFO: Saving data for WH49963: {'created_time': 1774697745.557079, 'last_price_update_time': 1774697745.557088, 'auction_closing_time': 1774882835.0}
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH49963') HTTP/1.1" 204 0
2026-03-28 11:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_baf845040bbddeb05e16af690400550e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_a8770f0515bbd0337cbad0a1b71456b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_5950b13ab38ab0f7a2570fcf9a01a651.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14ee0d0>
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_efd29e9a10e273904e9e044a4e3206fc.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_efd29e9a10e273904e9e044a4e3206fc.jpg saved to cache
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1503c50>
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_e21004229a001be603bf1b8e7b76ce34.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_e21004229a001be603bf1b8e7b76ce34.jpg saved to cache
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ab6650>
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F3b%252F0e3b22dd952cdc45a572635b48b6dc1f%252Fpa%252FDD83263_21fc355e73d612e3b674dcc5418d98bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_21fc355e73d612e3b674dcc5418d98bd.jpg saved to cache
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c32743c6-2b98-5c6e-87ba-bcd434b3cace
2026-03-28 11:35:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c32743c6-2b98-5c6e-87ba-bcd434b3cace, skipping ID generation
2026-03-28 11:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32743c6-2b98-5c6e-87ba-bcd434b3cace with scrape type 1
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c32743c6-2b98-5c6e-87ba-bcd434b3cace sending to next pipeline
2026-03-28 11:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c32743c6-2b98-5c6e-87ba-bcd434b3cace, identifier: DD83263
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b377d0>
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_c72edfc91b9aaf32ba0da7be021eda9d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_c72edfc91b9aaf32ba0da7be021eda9d.jpg saved to cache
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08acf10>
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F86%252Fc78604a8d91f531d0e64359ab061a981%252Fpa%252FPK02246_69c06715ddf8ba4fc8717a626d2a0b25.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_69c06715ddf8ba4fc8717a626d2a0b25.jpg saved to cache
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03849ee2-b597-56b3-a949-37d7f86bb163
2026-03-28 11:35:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03849ee2-b597-56b3-a949-37d7f86bb163, skipping ID generation
2026-03-28 11:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03849ee2-b597-56b3-a949-37d7f86bb163 with scrape type 1
2026-03-28 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03849ee2-b597-56b3-a949-37d7f86bb163 sending to next pipeline
2026-03-28 11:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 03849ee2-b597-56b3-a949-37d7f86bb163, identifier: PK02246
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ad07d0>
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_9d650a26f5eefceb34293acd42e2bd6c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_9d650a26f5eefceb34293acd42e2bd6c.jpg saved to cache
2026-03-28 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0915150>
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_cc7b524ade07b6ef2d5c3dcb0b36e533.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_cc7b524ade07b6ef2d5c3dcb0b36e533.jpg saved to cache
2026-03-28 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 11:35:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-28 11:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263 to the API
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_21fc355e73d612e3b674dcc5418d98bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:48Z',
 'fuel_type': 'diesel',
 'id': 'c32743c6-2b98-5c6e-87ba-bcd434b3cace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD83263',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 135430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_735318ea8d4fdeed5af5fd336c4d8196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_bddf3f12ef03889b678f25106efbdedf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_21fc355e73d612e3b674dcc5418d98bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_efd29e9a10e273904e9e044a4e3206fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2cd6c43c9741e6e33954b65c63832186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_2e3dae534c2eb9ffd6804617a2cc0248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_561397cb8e063066c3a992179c3a361d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_f14f39c0d39695cd022202c1c65b15d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_8de8d3b3fd263ab25b0ce5c4b6e31ef1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32743c6-2b98-5c6e-87ba-bcd434b3cace/c32743c6-2b98-5c6e-87ba-bcd434b3cace_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/3b/0e3b22dd952cdc45a572635b48b6dc1f/pa/DD83263_237a3aae125b71e459876ccbd6b3c901.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2018}
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-28 11:35:46 [auto1.be] INFO: Saving data for DD83263: {'created_time': 1774697746.642094, 'last_price_update_time': 1774697746.642104, 'auction_closing_time': 1774884108.0}
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD83263') HTTP/1.1" 204 0
2026-03-28 11:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-28 11:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-28 11:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246 to the API
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_69c06715ddf8ba4fc8717a626d2a0b25.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:42Z',
 'fuel_type': 'petrol',
 'id': '03849ee2-b597-56b3-a949-37d7f86bb163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK02246',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 130656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_10b1d66092eb801ecd47ec17e9e5e31c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_800ec8b533a89d9d40581b015d0d61b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d8d401b9415db88e4bb187c414637199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_d03f0e009c39e5f56c6483a4e0ce97cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_c722c9beb3490132da09e020aca946b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2735273,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_722941126ef186d0f644e26b99d6be3c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3bfe2f5cd10635eab55b8944950f16c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_e21004229a001be603bf1b8e7b76ce34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_69c06715ddf8ba4fc8717a626d2a0b25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03849ee2-b597-56b3-a949-37d7f86bb163/03849ee2-b597-56b3-a949-37d7f86bb163_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/86/c78604a8d91f531d0e64359ab061a981/pa/PK02246_3994bcd5dbab024fba86d47c64ff6e04.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 TCe Energy Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-28 11:35:46 [auto1.be] INFO: Saving data for PK02246: {'created_time': 1774697746.98808, 'last_price_update_time': 1774697746.98809, 'auction_closing_time': 1774883382.0}
2026-03-28 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK02246') HTTP/1.1" 204 0
2026-03-28 11:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU35051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0487c50>
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F7b%252F767b3e34a7ac87ca32a5d1a11f86fdad%252Fpa%252FEY57880_baf845040bbddeb05e16af690400550e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_baf845040bbddeb05e16af690400550e.jpg saved to cache
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c
2026-03-28 11:35:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c, skipping ID generation
2026-03-28 11:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with scrape type 1
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c sending to next pipeline
2026-03-28 11:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c, identifier: EY57880
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04868d0>
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_a8770f0515bbd0337cbad0a1b71456b8.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_a8770f0515bbd0337cbad0a1b71456b8.jpg saved to cache
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1549f10>
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_5950b13ab38ab0f7a2570fcf9a01a651.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_5950b13ab38ab0f7a2570fcf9a01a651.jpg saved to cache
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_eb080527006476ee57ae9d02c862d30f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-28 11:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-28 11:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880 to the API
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_baf845040bbddeb05e16af690400550e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:48Z',
 'fuel_type': 'petrol',
 'id': '70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY57880',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 95241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_04bd89521695045372e06cbae169d65d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b7c3a7fac5cfc719b356695a3f5e22be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_a20aa4ecd45c9e57c486b0015e72aa1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_baf845040bbddeb05e16af690400550e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_6e13b6e9e60028bc1196df4ab8c2c1f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_af85997963a4dae7d21604a6e5e4b347.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_b0d25bea7f6e4fd1044bfa2b8a0db4a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_1cc76bb7247c8638469e4cb9a20f36ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_39c5ab09e363f2191b43d6fa09a30ef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c/70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/7b/767b3e34a7ac87ca32a5d1a11f86fdad/pa/EY57880_c42eaf8b4983d4751528f89907bdd295.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-28 11:35:47 [auto1.be] INFO: Saving data for EY57880: {'created_time': 1774697747.628706, 'last_price_update_time': 1774697747.628715, 'auction_closing_time': 1774885968.0}
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EY57880') HTTP/1.1" 204 0
2026-03-28 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_aad59994cff39fee530ce31fbecc79c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_5f7f70f58cf47b862cd8733aa2d0d2b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_883d1b6bba46ec3d6755aebb4f37aade.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd087c350>
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F23%252F4423a87e983b6aacb87d29fc15430691%252Fpa%252FEJ96142_eb080527006476ee57ae9d02c862d30f.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_eb080527006476ee57ae9d02c862d30f.jpg saved to cache
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb779073-baaf-5e6e-a125-614e69685435
2026-03-28 11:35:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb779073-baaf-5e6e-a125-614e69685435, skipping ID generation
2026-03-28 11:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb779073-baaf-5e6e-a125-614e69685435 with scrape type 1
2026-03-28 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb779073-baaf-5e6e-a125-614e69685435 sending to next pipeline
2026-03-28 11:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb779073-baaf-5e6e-a125-614e69685435, identifier: EJ96142
2026-03-28 11:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-28 11:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-28 11:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142 to the API
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_eb080527006476ee57ae9d02c862d30f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'diesel',
 'id': 'bb779073-baaf-5e6e-a125-614e69685435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ96142',
 'listing': 'auction',
 'location': 'BE, Bornem',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 96641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_86d59875a6b0d81e486308278c1c6330.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_c72edfc91b9aaf32ba0da7be021eda9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_d7d61b5f40b0a93f9e1198bee604cead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_bcd791e10d98b7eb76cbfcaa53cf3f8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_216df981deb045b99ed94926986bbcc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_cd4a068f412fa3eac353a1beca033517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_eb080527006476ee57ae9d02c862d30f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a440b3738742868b9fb44dc54fc00195.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3162343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_a333751b32dafa4f1c728c70f5624b62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb779073-baaf-5e6e-a125-614e69685435/bb779073-baaf-5e6e-a125-614e69685435_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/23/4423a87e983b6aacb87d29fc15430691/pa/EJ96142_87d350cdb34fcfce055c32425b4de618.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2012}
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-28 11:35:48 [auto1.be] INFO: Saving data for EJ96142: {'created_time': 1774697748.264964, 'last_price_update_time': 1774697748.264973, 'auction_closing_time': 1774883052.0}
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ96142') HTTP/1.1" 204 0
2026-03-28 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_c35f8312fc0b8c16aad63eddf4112ee5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_6573f470d7ff0594848cc262d174d1a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_dfb19ffc5d1be942a07de1989f87767d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd146c310>
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F35%252F8535065d4ccee9998ee83c84400d87da%252Fpa%252FKB40459_aad59994cff39fee530ce31fbecc79c5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_aad59994cff39fee530ce31fbecc79c5.jpg saved to cache
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d42316a-0279-56f7-9b8e-5699d25c82b6
2026-03-28 11:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d42316a-0279-56f7-9b8e-5699d25c82b6, skipping ID generation
2026-03-28 11:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d42316a-0279-56f7-9b8e-5699d25c82b6 with scrape type 1
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d42316a-0279-56f7-9b8e-5699d25c82b6 sending to next pipeline
2026-03-28 11:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d42316a-0279-56f7-9b8e-5699d25c82b6, identifier: KB40459
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0acded0>
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fae%252F1dae22076d721a04e905943fb8670ad5%252Fpa%252FVK18525_5f7f70f58cf47b862cd8733aa2d0d2b1.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_5f7f70f58cf47b862cd8733aa2d0d2b1.jpg saved to cache
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58
2026-03-28 11:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac63ab8b-5a57-518e-8a93-9ff7350f7d58, skipping ID generation
2026-03-28 11:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58 with scrape type 1
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac63ab8b-5a57-518e-8a93-9ff7350f7d58 sending to next pipeline
2026-03-28 11:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac63ab8b-5a57-518e-8a93-9ff7350f7d58, identifier: VK18525
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04cacd0>
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F6f%252F4e6fe2c7e323110a40cba945c6678a00%252Fpa%252FSY87797_883d1b6bba46ec3d6755aebb4f37aade.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_883d1b6bba46ec3d6755aebb4f37aade.jpg saved to cache
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e46d3f0-0807-5b96-8849-00972b4d6143
2026-03-28 11:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e46d3f0-0807-5b96-8849-00972b4d6143, skipping ID generation
2026-03-28 11:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e46d3f0-0807-5b96-8849-00972b4d6143 with scrape type 1
2026-03-28 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e46d3f0-0807-5b96-8849-00972b4d6143 sending to next pipeline
2026-03-28 11:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e46d3f0-0807-5b96-8849-00972b4d6143, identifier: SY87797
2026-03-28 11:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-28 11:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-28 11:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459 to the API
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_aad59994cff39fee530ce31fbecc79c5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:44Z',
 'fuel_type': 'petrol',
 'id': '6d42316a-0279-56f7-9b8e-5699d25c82b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB40459',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 129413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_aad59994cff39fee530ce31fbecc79c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_f50d2468ec517321920f4b5cc12dfb24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_9d650a26f5eefceb34293acd42e2bd6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1961467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0c55ce07edf63bda31144cc5289110c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_92f1ed5eee7b43c4f595c43ce86e1a6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_746e4362f8e1bc922b3d58d565b1daf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_7a4936f27c50b3c5299e9714e689e88e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1797131,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_0e42a74f27b01b1803b00307edbb98f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2212786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_787db6f3eaaa8ce6f4e7d58ea9188056.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d42316a-0279-56f7-9b8e-5699d25c82b6/6d42316a-0279-56f7-9b8e-5699d25c82b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/35/8535065d4ccee9998ee83c84400d87da/pa/KB40459_da1382b9fd0ba3986b0e32b1addb8845.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-28 11:35:48 [auto1.be] INFO: Saving data for KB40459: {'created_time': 1774697748.969292, 'last_price_update_time': 1774697748.969308, 'auction_closing_time': 1774885904.0}
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KB40459') HTTP/1.1" 204 0
2026-03-28 11:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac63ab8b-5a57-518e-8a93-9ff7350f7d58 with identifier: VK18525
2026-03-28 11:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 11:35:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac63ab8b-5a57-518e-8a93-9ff7350f7d58 with identifier: VK18525
2026-03-28 11:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac63ab8b-5a57-518e-8a93-9ff7350f7d58 with identifier: VK18525 to the API
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_5f7f70f58cf47b862cd8733aa2d0d2b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'petrol',
 'id': 'ac63ab8b-5a57-518e-8a93-9ff7350f7d58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK18525',
 'listing': 'auction',
 'location': 'BE, Retie',
 'make': 'Porsche',
 'model': '924',
 'odometer': 57517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_5f7f70f58cf47b862cd8733aa2d0d2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_f7650332f0b423fe79bccab03967fa4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_cc7b524ade07b6ef2d5c3dcb0b36e533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_1696c827b514b0734d19c8b229257e57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_27f302049d8e387fb7ea5a6f441e6b95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_c794ea5493b368c470c0750ff3ff14e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_668594f6f9942e54183a8d0a7533bea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_6a71bea94e8785186f55a0544bf2a9ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_30c53cd820ea31b88d0d35cce62cd003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac63ab8b-5a57-518e-8a93-9ff7350f7d58/ac63ab8b-5a57-518e-8a93-9ff7350f7d58_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/ae/1dae22076d721a04e905943fb8670ad5/pa/VK18525_429f44d5138cafb56145e2a9725e3f72.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1982-04-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche 924 Basis',
 'transmission': 'manual',
 'trim': '',
 'year': 1982}
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK18525%27 HTTP/1.1" 200 None
2026-03-28 11:35:49 [auto1.be] INFO: Saving data for VK18525: {'created_time': 1774697749.470969, 'last_price_update_time': 1774697749.470979, 'auction_closing_time': 1774883713.0}
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VK18525') HTTP/1.1" 204 0
2026-03-28 11:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-28 11:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-28 11:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797 to the API
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_883d1b6bba46ec3d6755aebb4f37aade.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:48Z',
 'fuel_type': 'petrol',
 'id': '6e46d3f0-0807-5b96-8849-00972b4d6143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY87797',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 165349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_883d1b6bba46ec3d6755aebb4f37aade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_b8a30f24238cafbae2abbee0af2d814f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2510863,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_3ce8b1d484257fc020b79d8079300848.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425351,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_04d9523e2a82d09f5b8161722065f646.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_fb028444bd72f2b72dc481be2346ba08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592943,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_28af27dbb9739ed04f98c36342ed57c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_cbb7c299487ded2ceabad530894ccf81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_25a459a42ab69e684fbf9c8e4fa2dd15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_613968b1444d533ce924116670c06f67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e46d3f0-0807-5b96-8849-00972b4d6143/6e46d3f0-0807-5b96-8849-00972b4d6143_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/6f/4e6fe2c7e323110a40cba945c6678a00/pa/SY87797_d502cc6152b2a1908ff2b191194d81d3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-28 11:35:49 [auto1.be] INFO: Saving data for SY87797: {'created_time': 1774697749.821526, 'last_price_update_time': 1774697749.821536, 'auction_closing_time': 1774885368.0}
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY87797') HTTP/1.1" 204 0
2026-03-28 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_74812317316f6d82874fb534f79a588e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_1c00063eb5e4411cf3196c23ec68c645.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_44da24089da745dd18190e95399e9324.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a0ea10>
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_c35f8312fc0b8c16aad63eddf4112ee5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_c35f8312fc0b8c16aad63eddf4112ee5.jpg saved to cache
2026-03-28 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ed710>
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_6573f470d7ff0594848cc262d174d1a5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_6573f470d7ff0594848cc262d174d1a5.jpg saved to cache
2026-03-28 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14fd150>
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_dfb19ffc5d1be942a07de1989f87767d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_dfb19ffc5d1be942a07de1989f87767d.jpg saved to cache
2026-03-28 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad137d48-5892-529d-9804-3a64ab9edc12
2026-03-28 11:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd139dad0>
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_74812317316f6d82874fb534f79a588e.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_74812317316f6d82874fb534f79a588e.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e433a844-a689-5367-8714-653fee095003
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ae0750>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_1c00063eb5e4411cf3196c23ec68c645.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_1c00063eb5e4411cf3196c23ec68c645.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a37c90>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_44da24089da745dd18190e95399e9324.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_44da24089da745dd18190e95399e9324.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_dbaa58556e08206139dacedcccd326f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_054e5e1f4347a11d0d36c86926ef5900.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_e78dd7d0400c642068853952a207c2d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_caf01eb7a1615140592e259200b81a8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_ea1233fc8e96eb2d4afe75b4ad07566d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_f7c0d4980f000c5a1be8a8ee405664cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_262b6e6f0133250c2f96f6a10fff53eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_007144d0d19368f9684e84050ec4a01c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_713df8feca196b6b959b01ceda5c702a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_0799e92660f35ea2a09fb2fa4a617a69.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_69049c28ca9309fa3c9e9b9eddd82311.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1385290>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_dbaa58556e08206139dacedcccd326f2.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_dbaa58556e08206139dacedcccd326f2.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a57750>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_054e5e1f4347a11d0d36c86926ef5900.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_054e5e1f4347a11d0d36c86926ef5900.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1521a90>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F99%252F1d99f614ae79b7f240321fdc48984a54%252Fpa%252FHE39793_e78dd7d0400c642068853952a207c2d4.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_e78dd7d0400c642068853952a207c2d4.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 504aed41-bf6e-5884-9e2f-adf46851589d
2026-03-28 11:35:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 504aed41-bf6e-5884-9e2f-adf46851589d, skipping ID generation
2026-03-28 11:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504aed41-bf6e-5884-9e2f-adf46851589d with scrape type 1
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 504aed41-bf6e-5884-9e2f-adf46851589d sending to next pipeline
2026-03-28 11:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 504aed41-bf6e-5884-9e2f-adf46851589d, identifier: HE39793
2026-03-28 11:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35bb350>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_caf01eb7a1615140592e259200b81a8b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_caf01eb7a1615140592e259200b81a8b.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09d8f90>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F43%252Ffa430ac3f359f5f3b7f5477ba6abdeb5%252Fpa%252FGM14941_ea1233fc8e96eb2d4afe75b4ad07566d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_ea1233fc8e96eb2d4afe75b4ad07566d.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a
2026-03-28 11:35:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e7864f8-93d6-521c-8d1b-1354badf6d8a, skipping ID generation
2026-03-28 11:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a with scrape type 1
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a sending to next pipeline
2026-03-28 11:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e7864f8-93d6-521c-8d1b-1354badf6d8a, identifier: GM14941
2026-03-28 11:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04a71d0>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_f7c0d4980f000c5a1be8a8ee405664cc.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_f7c0d4980f000c5a1be8a8ee405664cc.jpg saved to cache
2026-03-28 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1521f50>
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fb6%252Fddb633a118c90314a706ffb5d5d680d1%252Fpa%252FXC95069_262b6e6f0133250c2f96f6a10fff53eb.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_262b6e6f0133250c2f96f6a10fff53eb.jpg saved to cache
2026-03-28 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb2d479b-7554-5303-94e6-76865bc86c59
2026-03-28 11:35:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb2d479b-7554-5303-94e6-76865bc86c59, skipping ID generation
2026-03-28 11:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2d479b-7554-5303-94e6-76865bc86c59 with scrape type 1
2026-03-28 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb2d479b-7554-5303-94e6-76865bc86c59 sending to next pipeline
2026-03-28 11:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb2d479b-7554-5303-94e6-76865bc86c59, identifier: XC95069
2026-03-28 11:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd153d710>
2026-03-28 11:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_007144d0d19368f9684e84050ec4a01c.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_007144d0d19368f9684e84050ec4a01c.jpg saved to cache
2026-03-28 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e433a844-a689-5367-8714-653fee095003
2026-03-28 11:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-28 11:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-28 11:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793 to the API
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_e78dd7d0400c642068853952a207c2d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:34:25Z',
 'fuel_type': 'petrol',
 'id': '504aed41-bf6e-5884-9e2f-adf46851589d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE39793',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 81585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2865958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_05a306a34e37dbf9c609d0611b2710d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_649a3c6d7be0faadf1264b2e5e0ea7ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_fdba9db56b4147fbad4b18288b87fa23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2532780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_ccbfe857d2c7f9e2e95f4b0f5aa22b57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3153540,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_907fbdf616daeaabed862daa73c5a26a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_1f786fa9a48324b10bdd6eb800d42f6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_44e8ccf1d19b8c02f327b71df22b0e96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_5c77f35fa0cf1ea35c6ee53fe7b76b45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000020,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_e78dd7d0400c642068853952a207c2d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504aed41-bf6e-5884-9e2f-adf46851589d/504aed41-bf6e-5884-9e2f-adf46851589d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/99/1d99f614ae79b7f240321fdc48984a54/pa/HE39793_4152777952c9fc2dc9c071ce1f302f9e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-28 11:35:51 [auto1.be] INFO: Saving data for HE39793: {'created_time': 1774697751.583659, 'last_price_update_time': 1774697751.583669, 'auction_closing_time': 1774884865.0}
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE39793') HTTP/1.1" 204 0
2026-03-28 11:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-28 11:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-28 11:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941 to the API
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_ea1233fc8e96eb2d4afe75b4ad07566d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'petrol',
 'id': '6e7864f8-93d6-521c-8d1b-1354badf6d8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM14941',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 16541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_dbaa58556e08206139dacedcccd326f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_55554ce99ce3e70fd916f2b42120dfab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_1c00063eb5e4411cf3196c23ec68c645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_c35f8312fc0b8c16aad63eddf4112ee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_de47c25103dab53b5b2db2ffb3da2e10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2361320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_ea1233fc8e96eb2d4afe75b4ad07566d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_caf01eb7a1615140592e259200b81a8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_5950b13ab38ab0f7a2570fcf9a01a651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_994fbf75cfd338ef34dc3f0c97c3c528.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e7864f8-93d6-521c-8d1b-1354badf6d8a/6e7864f8-93d6-521c-8d1b-1354badf6d8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/43/fa430ac3f359f5f3b7f5477ba6abdeb5/pa/GM14941_548683929f7e154f5272a8853ec67106.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 0.9 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-28 11:35:51 [auto1.be] INFO: Saving data for GM14941: {'created_time': 1774697751.947689, 'last_price_update_time': 1774697751.947698, 'auction_closing_time': 1774884663.0}
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM14941') HTTP/1.1" 204 0
2026-03-28 11:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-28 11:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-28 11:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069 to the API
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_262b6e6f0133250c2f96f6a10fff53eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:45:50Z',
 'fuel_type': 'petrol',
 'id': 'bb2d479b-7554-5303-94e6-76865bc86c59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC95069',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 109962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_054e5e1f4347a11d0d36c86926ef5900.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_37c7c162397c9bf214080f2a550969fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_44da24089da745dd18190e95399e9324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_6573f470d7ff0594848cc262d174d1a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_041afe7357bffc492bfdd5d77e0e74b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3272136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_262b6e6f0133250c2f96f6a10fff53eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_f7c0d4980f000c5a1be8a8ee405664cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_a8770f0515bbd0337cbad0a1b71456b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_ae2bdf8f027e3532d07d3ea505a1f506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2d479b-7554-5303-94e6-76865bc86c59/bb2d479b-7554-5303-94e6-76865bc86c59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/b6/ddb633a118c90314a706ffb5d5d680d1/pa/XC95069_fdb6dbd662288144e7342bded67edc96.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-28 11:35:52 [auto1.be] INFO: Saving data for XC95069: {'created_time': 1774697752.335925, 'last_price_update_time': 1774697752.335959, 'auction_closing_time': 1774885550.0}
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC95069') HTTP/1.1" 204 0
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04be550>
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_713df8feca196b6b959b01ceda5c702a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_713df8feca196b6b959b01ceda5c702a.jpg saved to cache
2026-03-28 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad137d48-5892-529d-9804-3a64ab9edc12
2026-03-28 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_60855c4a1262b0dddd3ad685a69d17e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_08a812932092b11f209ca4e34d51b6ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE51169/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY92003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV64774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB88665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU35051> (referer: https://www.auto1.com/v1/car-details-view/CU35051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1560110>
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd7%252F3cd7908fef3546247db23aae44ce542d%252Fpa%252FCE40234_0799e92660f35ea2a09fb2fa4a617a69.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_0799e92660f35ea2a09fb2fa4a617a69.jpg saved to cache
2026-03-28 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad137d48-5892-529d-9804-3a64ab9edc12
2026-03-28 11:35:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad137d48-5892-529d-9804-3a64ab9edc12, skipping ID generation
2026-03-28 11:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad137d48-5892-529d-9804-3a64ab9edc12 with scrape type 1
2026-03-28 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad137d48-5892-529d-9804-3a64ab9edc12 sending to next pipeline
2026-03-28 11:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad137d48-5892-529d-9804-3a64ab9edc12, identifier: CE40234
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a79610>
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_69049c28ca9309fa3c9e9b9eddd82311.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_69049c28ca9309fa3c9e9b9eddd82311.jpg saved to cache
2026-03-28 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9
2026-03-28 11:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad137d48-5892-529d-9804-3a64ab9edc12 with identifier: CE40234
2026-03-28 11:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad137d48-5892-529d-9804-3a64ab9edc12 with identifier: CE40234
2026-03-28 11:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad137d48-5892-529d-9804-3a64ab9edc12 with identifier: CE40234 to the API
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_0799e92660f35ea2a09fb2fa4a617a69.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 2',
 'engine': '1.1L',
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:04:14Z',
 'fuel_type': 'petrol',
 'id': 'ad137d48-5892-529d-9804-3a64ab9edc12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE40234',
 'listing': 'auction',
 'location': 'BE, Sint-Truiden',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 100900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_977096f547dc54ecd6489b1dae74e478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_0799e92660f35ea2a09fb2fa4a617a69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_713df8feca196b6b959b01ceda5c702a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_c3efe0491d26de683f711211db445a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_f215bc5bd262a249d17becf72e372c56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad137d48-5892-529d-9804-3a64ab9edc12/ad137d48-5892-529d-9804-3a64ab9edc12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d7/3cd7908fef3546247db23aae44ce542d/pa/CE40234_dfb19ffc5d1be942a07de1989f87767d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.2 Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2005}
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE40234%27 HTTP/1.1" 200 None
2026-03-28 11:35:52 [auto1.be] INFO: Saving data for CE40234: {'created_time': 1774697752.951728, 'last_price_update_time': 1774697752.951738, 'auction_closing_time': 1774883054.0}
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE40234') HTTP/1.1" 204 0
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU18930> (referer: https://www.auto1.com/v1/car-details-view/BU18930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09f80d0>
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_60855c4a1262b0dddd3ad685a69d17e3.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_60855c4a1262b0dddd3ad685a69d17e3.jpg saved to cache
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e433a844-a689-5367-8714-653fee095003
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1520f90>
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_08a812932092b11f209ca4e34d51b6ce.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_08a812932092b11f209ca4e34d51b6ce.jpg saved to cache
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e433a844-a689-5367-8714-653fee095003
2026-03-28 11:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-28 11:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf76b278-56a0-5646-a2a7-de1723011ba0 with scrape type 1
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_ee0e474f660916e90bb17a03f20e1bdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ee0e474f660916e90bb17a03f20e1bdd.jpg not downloaded yet
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_2413c3f0fc9e6714f5bcf88010d6819d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_76137c7d770b084f2407cdc8b9d8d82b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_301eebef5bfa5ad699819e7a2812ea51.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_301eebef5bfa5ad699819e7a2812ea51.jpg not downloaded yet
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_ebc02592857ef9f02ff9056eb73fbefa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_ad6e0858a1eb70c7816abc7ec83c5d7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_924a2fa20b187eae8ba72fb6b6b95b1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-28 11:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41becf54-0430-5c07-8557-5a3865934ccf with scrape type 1
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 41becf54-0430-5c07-8557-5a3865934ccf
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F44%252Fc04455bdf46c50bafa18e6407f5d6dd5%252Fpa%252FBU18930_cd9090dac510d6d6461c964a346dece8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_cd9090dac510d6d6461c964a346dece8.jpg already downloaded
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F44%252Fc04455bdf46c50bafa18e6407f5d6dd5%252Fpa%252FBU18930_f024b7a469df42c3fc628cbcf1d1558d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_f024b7a469df42c3fc628cbcf1d1558d.jpg already downloaded
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F44%252Fc04455bdf46c50bafa18e6407f5d6dd5%252Fpa%252FBU18930_bb0c0057721cf2228504137e5ee27bc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_bb0c0057721cf2228504137e5ee27bc9.jpg already downloaded
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F44%252Fc04455bdf46c50bafa18e6407f5d6dd5%252Fpa%252FBU18930_17df354fd7c5ef194a1732f6ad53a3a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_17df354fd7c5ef194a1732f6ad53a3a7.jpg already downloaded
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F44%252Fc04455bdf46c50bafa18e6407f5d6dd5%252Fpa%252FBU18930_c52d475c90b4270af0ad72d93f2c50fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_c52d475c90b4270af0ad72d93f2c50fa.jpg already downloaded
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F44%252Fc04455bdf46c50bafa18e6407f5d6dd5%252Fpa%252FBU18930_7fe7fd992f4c7773f878161a3b1666a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_7fe7fd992f4c7773f878161a3b1666a4.jpg already downloaded
2026-03-28 11:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41becf54-0430-5c07-8557-5a3865934ccf, identifier: BU18930
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_63e9a8f136bd59757550e23812df6a79.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_63e9a8f136bd59757550e23812df6a79.jpg not downloaded yet
2026-03-28 11:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-28 11:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-28 11:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930 to the API
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU18930>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:01Z',
 'fuel_type': 'diesel',
 'id': '41becf54-0430-5c07-8557-5a3865934ccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU18930',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 275170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_cd9090dac510d6d6461c964a346dece8.jpg',
                'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_f024b7a469df42c3fc628cbcf1d1558d.jpg',
                'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_bb0c0057721cf2228504137e5ee27bc9.jpg',
                'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_17df354fd7c5ef194a1732f6ad53a3a7.jpg',
                'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_c52d475c90b4270af0ad72d93f2c50fa.jpg',
                'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_7fe7fd992f4c7773f878161a3b1666a4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41becf54-0430-5c07-8557-5a3865934ccf/41becf54-0430-5c07-8557-5a3865934ccf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_cd9090dac510d6d6461c964a346dece8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41becf54-0430-5c07-8557-5a3865934ccf/41becf54-0430-5c07-8557-5a3865934ccf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_f024b7a469df42c3fc628cbcf1d1558d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41becf54-0430-5c07-8557-5a3865934ccf/41becf54-0430-5c07-8557-5a3865934ccf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_bb0c0057721cf2228504137e5ee27bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41becf54-0430-5c07-8557-5a3865934ccf/41becf54-0430-5c07-8557-5a3865934ccf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_17df354fd7c5ef194a1732f6ad53a3a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41becf54-0430-5c07-8557-5a3865934ccf/41becf54-0430-5c07-8557-5a3865934ccf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_c52d475c90b4270af0ad72d93f2c50fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41becf54-0430-5c07-8557-5a3865934ccf/41becf54-0430-5c07-8557-5a3865934ccf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/44/c04455bdf46c50bafa18e6407f5d6dd5/pa/BU18930_7fe7fd992f4c7773f878161a3b1666a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [auto1.be] INFO: Saving data for BU18930: {'created_time': 1774697753.745961, 'last_price_update_time': 1774697753.745971, 'auction_closing_time': 1774883941.0}
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU18930') HTTP/1.1" 204 0
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0b7b717c5d92555beaf46cc66f094bd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_a71948b86098aed918c65141be67fcee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_a71948b86098aed918c65141be67fcee.jpg not downloaded yet
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_fe60ee2129a707f12af0c52f9a3e1f98.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_cf26220b663cae55e57ccf1b6d7318f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0940410>
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F39%252Faf392fc046671d49edda3c23fe0ad0aa%252Fpa%252FFW70524_2413c3f0fc9e6714f5bcf88010d6819d.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_2413c3f0fc9e6714f5bcf88010d6819d.jpg saved to cache
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9
2026-03-28 11:35:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9, skipping ID generation
2026-03-28 11:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with scrape type 1
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 sending to next pipeline
2026-03-28 11:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9, identifier: FW70524
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35baf50>
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_76137c7d770b084f2407cdc8b9d8d82b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_76137c7d770b084f2407cdc8b9d8d82b.jpg saved to cache
2026-03-28 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b36e50>
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F08%252F670809d74258713cb16834bc44986985%252Fpa%252FBS70441_ebc02592857ef9f02ff9056eb73fbefa.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_ebc02592857ef9f02ff9056eb73fbefa.jpg saved to cache
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e433a844-a689-5367-8714-653fee095003
2026-03-28 11:35:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e433a844-a689-5367-8714-653fee095003, skipping ID generation
2026-03-28 11:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e433a844-a689-5367-8714-653fee095003 with scrape type 1
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e433a844-a689-5367-8714-653fee095003 sending to next pipeline
2026-03-28 11:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e433a844-a689-5367-8714-653fee095003, identifier: BS70441
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd090eb10>
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_ad6e0858a1eb70c7816abc7ec83c5d7b.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_ad6e0858a1eb70c7816abc7ec83c5d7b.jpg saved to cache
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0483790>
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_924a2fa20b187eae8ba72fb6b6b95b1a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_924a2fa20b187eae8ba72fb6b6b95b1a.jpg saved to cache
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_e89718fc0d2598f02e47c97a61e190c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_e89718fc0d2598f02e47c97a61e190c6.jpg not downloaded yet
2026-03-28 11:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-28 11:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-28 11:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524 to the API
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_2413c3f0fc9e6714f5bcf88010d6819d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'diesel',
 'id': '2e352c4e-7a8e-506f-8bfb-ccdde942a5e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW70524',
 'listing': 'auction',
 'location': 'BE, Rochefort',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 282602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c6ee210017156067a63034d3c122fbae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c7e1e1dc338d86643f61bad68e9d2575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_2413c3f0fc9e6714f5bcf88010d6819d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_c414c0624c4efdcd800d2d3f2a27b6ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_7b3c8a0d551fed85ae6577adf3d656ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e352c4e-7a8e-506f-8bfb-ccdde942a5e9/2e352c4e-7a8e-506f-8bfb-ccdde942a5e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/39/af392fc046671d49edda3c23fe0ad0aa/pa/FW70524_69049c28ca9309fa3c9e9b9eddd82311.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-28 11:35:54 [auto1.be] INFO: Saving data for FW70524: {'created_time': 1774697754.743089, 'last_price_update_time': 1774697754.743101, 'auction_closing_time': 1774885654.0}
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW70524') HTTP/1.1" 204 0
2026-03-28 11:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-28 11:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-28 11:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441 to the API
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_ebc02592857ef9f02ff9056eb73fbefa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:35:56Z',
 'fuel_type': 'petrol',
 'id': 'e433a844-a689-5367-8714-653fee095003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS70441',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 123064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_ebc02592857ef9f02ff9056eb73fbefa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_60855c4a1262b0dddd3ad685a69d17e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_08a812932092b11f209ca4e34d51b6ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_007144d0d19368f9684e84050ec4a01c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_6924b93cc7a323899e67e15d4f74f59e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e433a844-a689-5367-8714-653fee095003/e433a844-a689-5367-8714-653fee095003_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/08/670809d74258713cb16834bc44986985/pa/BS70441_74812317316f6d82874fb534f79a588e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 140 L Classic',
 'transmission': 'automatic',
 'trim': 'L Classic',
 'year': 2004}
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [auto1.be] INFO: Saving data for BS70441: {'created_time': 1774697755.103194, 'last_price_update_time': 1774697755.103204, 'auction_closing_time': 1774884956.0}
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BS70441') HTTP/1.1" 204 0
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_0f75629069f6c2f03caae78977bd81f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_0f75629069f6c2f03caae78977bd81f9.jpg not downloaded yet
2026-03-28 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08fc510>
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_0b7b717c5d92555beaf46cc66f094bd5.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0b7b717c5d92555beaf46cc66f094bd5.jpg saved to cache
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09f22d0>
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_fe60ee2129a707f12af0c52f9a3e1f98.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_fe60ee2129a707f12af0c52f9a3e1f98.jpg saved to cache
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1432990>
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_cf26220b663cae55e57ccf1b6d7318f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_cf26220b663cae55e57ccf1b6d7318f3.jpg saved to cache
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73
2026-03-28 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_a69eeab9188f3f043ba0e7a4f9779bb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_f5583bc4a4e17af26a63f732ebd02150.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_feb42b5561f9f33e5ccbc200856ff88a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_ad350688e3ccacc6c3db742b10d41ecc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ad350688e3ccacc6c3db742b10d41ecc.jpg not downloaded yet
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_aeff575019bc78af9fa6af949b3d9876.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_aeff575019bc78af9fa6af949b3d9876.jpg not downloaded yet
2026-03-28 11:35:55 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1819 | hits on page: 40
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_4d0b6569a634048e8e8b4e7a05de5894.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_4d0b6569a634048e8e8b4e7a05de5894.jpg not downloaded yet
2026-03-28 11:35:55 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-28 11:35:55 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [auto1.be] INFO: Scrape type for ZN56944: 1
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_89f9d6df606f28a59f2e6dfcef841c40.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_89f9d6df606f28a59f2e6dfcef841c40.jpg not downloaded yet
2026-03-28 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ee0e474f660916e90bb17a03f20e1bdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:55 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-28 11:35:55 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [auto1.be] INFO: Scrape type for HX50025: 1
2026-03-28 11:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:55 [auto1.be] INFO: Found listing with ID: VW85401
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW85401%27 HTTP/1.1" 200 None
2026-03-28 11:35:55 [auto1.be] INFO: Scrape type for VW85401: 1
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08e6150>
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_a69eeab9188f3f043ba0e7a4f9779bb0.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_a69eeab9188f3f043ba0e7a4f9779bb0.jpg saved to cache
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5ce0f63850>
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_f5583bc4a4e17af26a63f732ebd02150.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_f5583bc4a4e17af26a63f732ebd02150.jpg saved to cache
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29a35d51-4951-5c9f-8818-3370273c76ff
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04be7d0>
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fbd%252Fc2bdc1be3a146f5b8cb790e2fcdbc11e%252Fpa%252FYZ92764_feb42b5561f9f33e5ccbc200856ff88a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_feb42b5561f9f33e5ccbc200856ff88a.jpg saved to cache
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73
2026-03-28 11:35:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73, skipping ID generation
2026-03-28 11:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with scrape type 1
2026-03-28 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 sending to next pipeline
2026-03-28 11:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73, identifier: YZ92764
2026-03-28 11:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 11:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-28 11:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764 to the API
2026-03-28 11:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_feb42b5561f9f33e5ccbc200856ff88a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:08Z',
 'fuel_type': 'diesel',
 'id': 'fa75fb00-33d1-5d0b-89b1-6d1bb5575d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ92764',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Toyota',
 'model': 'iQ',
 'odometer': 214536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_a69eeab9188f3f043ba0e7a4f9779bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_feb42b5561f9f33e5ccbc200856ff88a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_fe60ee2129a707f12af0c52f9a3e1f98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_cf26220b663cae55e57ccf1b6d7318f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_52433b45639a7ec1ddd4f8f67403f112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa75fb00-33d1-5d0b-89b1-6d1bb5575d73/fa75fb00-33d1-5d0b-89b1-6d1bb5575d73_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/bd/c2bdc1be3a146f5b8cb790e2fcdbc11e/pa/YZ92764_6ebb83782cc69e82f8c28ec3843a1285.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota iQ 1.4 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [auto1.be] INFO: Saving data for YZ92764: {'created_time': 1774697756.107384, 'last_price_update_time': 1774697756.107395, 'auction_closing_time': 1774885448.0}
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ92764') HTTP/1.1" 204 0
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [auto1.be] INFO: Scrape type for DH53723: 1
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_63e9a8f136bd59757550e23812df6a79.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_301eebef5bfa5ad699819e7a2812ea51.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_0f75629069f6c2f03caae78977bd81f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: AV16828
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [auto1.be] INFO: Scrape type for RD62823: 2
2026-03-28 11:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-28 11:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with scrape type 2
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with scrape type 2
2026-03-28 11:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b, identifier: RD62823
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV64774> (referer: https://www.auto1.com/v1/car-details-view/NV64774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB88665> (referer: https://www.auto1.com/v1/car-details-view/JB88665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY92003> (referer: https://www.auto1.com/v1/car-details-view/UY92003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-28 11:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-28 11:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823 to the API
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:11Z',
 'fuel_type': 'petrol',
 'id': '0d409237-307b-5e19-8cb0-ecf6fed7aa3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD62823',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 137580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-20',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Latitude',
 'transmission': 'manual',
 'trim': 'Latitude',
 'year': 2008}
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [auto1.be] INFO: Saving data for RD62823: {'auction_closing_time': 1774884491.0, 'created_time': 1773384047.537483, 'last_price_update_time': 1774697756.590454}
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD62823') HTTP/1.1" 204 0
2026-03-28 11:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09b92d0>
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_ee0e474f660916e90bb17a03f20e1bdd.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ee0e474f660916e90bb17a03f20e1bdd.jpg saved to cache
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: MB27937
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB27937%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [auto1.be] INFO: Scrape type for MB27937: 1
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_a71948b86098aed918c65141be67fcee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_e89718fc0d2598f02e47c97a61e190c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_42a14d2648f9ab68fb281508c199909f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [auto1.be] INFO: Scrape type for ZG72967: 1
2026-03-28 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE51169> (referer: https://www.auto1.com/v1/car-details-view/KE51169/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1429a50>
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_63e9a8f136bd59757550e23812df6a79.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_63e9a8f136bd59757550e23812df6a79.jpg saved to cache
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a80f50>
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_301eebef5bfa5ad699819e7a2812ea51.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_301eebef5bfa5ad699819e7a2812ea51.jpg saved to cache
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a06690>
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_0f75629069f6c2f03caae78977bd81f9.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_0f75629069f6c2f03caae78977bd81f9.jpg saved to cache
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-28 11:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb386063-39c7-587d-ad9a-ff6800bae828 with scrape type 1
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cb386063-39c7-587d-ad9a-ff6800bae828
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_175fc3fe2bcdaeba08579feaae5b6f67.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_175fc3fe2bcdaeba08579feaae5b6f67.jpg not downloaded yet
2026-03-28 11:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9 with identifier: JB88665
2026-03-28 11:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9 with scrape type 1
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_34d7f6408bc87bd92c7de222888033de.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_34d7f6408bc87bd92c7de222888033de.jpg not downloaded yet
2026-03-28 11:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-28 11:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0371ffca-6417-5000-9cfe-c3e1707bd28b with scrape type 1
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0371ffca-6417-5000-9cfe-c3e1707bd28b
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_79233f09460d1397965f58e1b9039552.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_79233f09460d1397965f58e1b9039552.jpg not downloaded yet
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-28 11:35:56 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-28 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for UH00217: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_fbbf9e77cfd2257520fda045844c3b42.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_fbbf9e77cfd2257520fda045844c3b42.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_fb5de49dab6507c63417b92ad0edaefb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb5de49dab6507c63417b92ad0edaefb.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_6033dd6f4256b10e675bb485a74c1b24.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_6033dd6f4256b10e675bb485a74c1b24.jpg not downloaded yet
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13ad790>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_a71948b86098aed918c65141be67fcee.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_a71948b86098aed918c65141be67fcee.jpg saved to cache
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1472f50>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_e89718fc0d2598f02e47c97a61e190c6.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_e89718fc0d2598f02e47c97a61e190c6.jpg saved to cache
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a465d0>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_42a14d2648f9ab68fb281508c199909f.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_42a14d2648f9ab68fb281508c199909f.jpg saved to cache
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29a35d51-4951-5c9f-8818-3370273c76ff
2026-03-28 11:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-28 11:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6952caac-088e-5006-9a46-9b48f1abe497 with scrape type 1
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_cbdb0ec0d501bf36b0d38b23980fb72b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_cbdb0ec0d501bf36b0d38b23980fb72b.jpg not downloaded yet
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for EU75132: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_dba206d0ca8b53009f2635cb7f6d67ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_dba206d0ca8b53009f2635cb7f6d67ea.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_fb3b993c1b67636517dbd7d4d68d9e25.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb3b993c1b67636517dbd7d4d68d9e25.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_9f677a6ceee06dc0c6beb6bb35da0cb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_9f677a6ceee06dc0c6beb6bb35da0cb4.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_aebdb07cad503a2ff0528fb6fc5f507e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_aebdb07cad503a2ff0528fb6fc5f507e.jpg not downloaded yet
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_89f9d6df606f28a59f2e6dfcef841c40.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_aeff575019bc78af9fa6af949b3d9876.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_4d0b6569a634048e8e8b4e7a05de5894.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for JY01361: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_3fa09d75810dbc77da427d6dc0ad971c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_3fa09d75810dbc77da427d6dc0ad971c.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_f99c0deb3cd4ff8a07fa4185ceb139c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_f99c0deb3cd4ff8a07fa4185ceb139c9.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_2007a27acf9cb22e5a99f469b166b3dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2007a27acf9cb22e5a99f469b166b3dc.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_5ad524ce52e7d87ff38fdf063b71c825.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_5ad524ce52e7d87ff38fdf063b71c825.jpg not downloaded yet
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for FK09845: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_b3e579110965d8e1cabeeabb31463f8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_b3e579110965d8e1cabeeabb31463f8a.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_0f064323329c432101445758f53f3a71.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0f064323329c432101445758f53f3a71.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_d87ff2f3979a44a879c048d0820f748f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_d87ff2f3979a44a879c048d0820f748f.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_fe1de5786723d4dc6f8353b2798bf4aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_fe1de5786723d4dc6f8353b2798bf4aa.jpg not downloaded yet
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for EB31921: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_e45d7a78dc15cc8cbd95b7e2bba299d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_e45d7a78dc15cc8cbd95b7e2bba299d1.jpg not downloaded yet
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_2ad2b736b534efa543f5c7f33eff0f88.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2ad2b736b534efa543f5c7f33eff0f88.jpg not downloaded yet
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN56944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_9f677a6ceee06dc0c6beb6bb35da0cb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_30329198c45613fd3b32f9b422c9830f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_30329198c45613fd3b32f9b422c9830f.jpg not downloaded yet
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a46b50>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_89f9d6df606f28a59f2e6dfcef841c40.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_89f9d6df606f28a59f2e6dfcef841c40.jpg saved to cache
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b52d10>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_aeff575019bc78af9fa6af949b3d9876.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_aeff575019bc78af9fa6af949b3d9876.jpg saved to cache
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a89d10>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_4d0b6569a634048e8e8b4e7a05de5894.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_4d0b6569a634048e8e8b4e7a05de5894.jpg saved to cache
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_24de344077f7524fb15b8a168c6edbc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for DJ63605: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_0ba3bfcd8b6754c2ef4879ae34d33692.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0ba3bfcd8b6754c2ef4879ae34d33692.jpg not downloaded yet
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_df397c623a508e51892220ad528cb08a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_a627ed0d82bc3792873aa4bcd4d1b727.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a627ed0d82bc3792873aa4bcd4d1b727.jpg not downloaded yet
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ad350688e3ccacc6c3db742b10d41ecc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: US61346
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for TC61218: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_0a82427b71b9adae5ad4e1eb2d5e68ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0a82427b71b9adae5ad4e1eb2d5e68ac.jpg not downloaded yet
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW85401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_97dac85e62b4a3fc772e0aa49e56a047.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_97dac85e62b4a3fc772e0aa49e56a047.jpg not downloaded yet
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13cbf50>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_9f677a6ceee06dc0c6beb6bb35da0cb4.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_9f677a6ceee06dc0c6beb6bb35da0cb4.jpg saved to cache
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0371ffca-6417-5000-9cfe-c3e1707bd28b
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9c3b10c8f22e3a19febbb7875524e0a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [auto1.be] INFO: Scrape type for PP72448: 1
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_b892bd7e7993c8e6053afebcfad29720.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_b892bd7e7993c8e6053afebcfad29720.jpg not downloaded yet
2026-03-28 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_6c2d85e38fd1862dab799a7793df9a90.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_4acbe8fca7837e6428777b829abe1ee3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_4acbe8fca7837e6428777b829abe1ee3.jpg not downloaded yet
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1419510>
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_24de344077f7524fb15b8a168c6edbc6.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_24de344077f7524fb15b8a168c6edbc6.jpg saved to cache
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29a35d51-4951-5c9f-8818-3370273c76ff
2026-03-28 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_d87ff2f3979a44a879c048d0820f748f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb3b993c1b67636517dbd7d4d68d9e25.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:58 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-28 11:35:58 [auto1.be] INFO: Scrape type for EV21741: 1
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_a964b9977f74a84e966870d073377e51.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_a964b9977f74a84e966870d073377e51.jpg not downloaded yet
2026-03-28 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX50025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_dba206d0ca8b53009f2635cb7f6d67ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_a8f1c35a913c2967d9979a953b0cdc4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a8f1c35a913c2967d9979a953b0cdc4a.jpg not downloaded yet
2026-03-28 11:35:58 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-28 11:35:58 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-28 11:35:58 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-28 11:35:58 [auto1.be] INFO: Scrape type for BZ95673: 1
2026-03-28 11:35:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd141bc10>
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F59%252F755903b055d81ac856fba5900f9d5443%252Fpa%252FAC55620_df397c623a508e51892220ad528cb08a.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_df397c623a508e51892220ad528cb08a.jpg saved to cache
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3505842-9219-5595-bcdf-7e483fd8cc77
2026-03-28 11:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3505842-9219-5595-bcdf-7e483fd8cc77, skipping ID generation
2026-03-28 11:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3505842-9219-5595-bcdf-7e483fd8cc77 with scrape type 1
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3505842-9219-5595-bcdf-7e483fd8cc77 sending to next pipeline
2026-03-28 11:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3505842-9219-5595-bcdf-7e483fd8cc77, identifier: AC55620
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08d91d0>
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F03%252Fec0308816f60ce4b488304e7321e374c%252Fpa%252FCU35051_ad350688e3ccacc6c3db742b10d41ecc.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ad350688e3ccacc6c3db742b10d41ecc.jpg saved to cache
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf76b278-56a0-5646-a2a7-de1723011ba0
2026-03-28 11:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf76b278-56a0-5646-a2a7-de1723011ba0, skipping ID generation
2026-03-28 11:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf76b278-56a0-5646-a2a7-de1723011ba0 with scrape type 1
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf76b278-56a0-5646-a2a7-de1723011ba0 sending to next pipeline
2026-03-28 11:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf76b278-56a0-5646-a2a7-de1723011ba0, identifier: CU35051
2026-03-28 11:35:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35c2210>
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_9c3b10c8f22e3a19febbb7875524e0a9.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9c3b10c8f22e3a19febbb7875524e0a9.jpg saved to cache
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2ad2b736b534efa543f5c7f33eff0f88.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_8786f3eaf6779ecebf6f62b6d14eeac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_8786f3eaf6779ecebf6f62b6d14eeac0.jpg not downloaded yet
2026-03-28 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-28 11:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-28 11:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620 to the API
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_df397c623a508e51892220ad528cb08a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:32Z',
 'fuel_type': 'diesel',
 'id': 'd3505842-9219-5595-bcdf-7e483fd8cc77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC55620',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_76137c7d770b084f2407cdc8b9d8d82b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2685371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_df397c623a508e51892220ad528cb08a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_924a2fa20b187eae8ba72fb6b6b95b1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d013ddd48a5233c20bbab6d8c911f21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_89d530ee43b351d316b5c9facb95bebd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_583f01870f731cdf3448e5352e9dfd24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2546529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_d889dad9ade14ee2c31df0c4112647fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_966c948eb207fbdd287f4c196248a126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_f56a7759637940276074b50d4130b9a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3505842-9219-5595-bcdf-7e483fd8cc77/d3505842-9219-5595-bcdf-7e483fd8cc77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/59/755903b055d81ac856fba5900f9d5443/pa/AC55620_6cd3088c10c78219162e7c5ec1b82281.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-28 11:35:59 [auto1.be] INFO: Saving data for AC55620: {'created_time': 1774697759.100817, 'last_price_update_time': 1774697759.100826, 'auction_closing_time': 1774883852.0}
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AC55620') HTTP/1.1" 204 0
2026-03-28 11:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-28 11:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-28 11:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051 to the API
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ad350688e3ccacc6c3db742b10d41ecc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'diesel',
 'id': 'cf76b278-56a0-5646-a2a7-de1723011ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU35051',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 206651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ee0e474f660916e90bb17a03f20e1bdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_301eebef5bfa5ad699819e7a2812ea51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_63e9a8f136bd59757550e23812df6a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_a71948b86098aed918c65141be67fcee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_e89718fc0d2598f02e47c97a61e190c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_0f75629069f6c2f03caae78977bd81f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_ad350688e3ccacc6c3db742b10d41ecc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_aeff575019bc78af9fa6af949b3d9876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_4d0b6569a634048e8e8b4e7a05de5894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf76b278-56a0-5646-a2a7-de1723011ba0/cf76b278-56a0-5646-a2a7-de1723011ba0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/03/ec0308816f60ce4b488304e7321e374c/pa/CU35051_89f9d6df606f28a59f2e6dfcef841c40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-28 11:35:59 [auto1.be] INFO: Saving data for CU35051: {'created_time': 1774697759.542206, 'last_price_update_time': 1774697759.542216, 'auction_closing_time': 1774886122.0}
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU35051') HTTP/1.1" 204 0
2026-03-28 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0ba3bfcd8b6754c2ef4879ae34d33692.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:59 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-28 11:35:59 [auto1.be] INFO: Scrape type for AG16412: 1
2026-03-28 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a627ed0d82bc3792873aa4bcd4d1b727.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH53723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB27937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:35:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0aba8d0>
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_6c2d85e38fd1862dab799a7793df9a90.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_6c2d85e38fd1862dab799a7793df9a90.jpg saved to cache
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09e1310>
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_d87ff2f3979a44a879c048d0820f748f.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_d87ff2f3979a44a879c048d0820f748f.jpg saved to cache
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0371ffca-6417-5000-9cfe-c3e1707bd28b
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ae890>
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_fb3b993c1b67636517dbd7d4d68d9e25.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb3b993c1b67636517dbd7d4d68d9e25.jpg saved to cache
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09e3490>
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_dba206d0ca8b53009f2635cb7f6d67ea.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_dba206d0ca8b53009f2635cb7f6d67ea.jpg saved to cache
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb386063-39c7-587d-ad9a-ff6800bae828
2026-03-28 11:35:59 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-28 11:35:59 [auto1.be] INFO: Scrape type for TM16327: 1
2026-03-28 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd37b2950>
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_2ad2b736b534efa543f5c7f33eff0f88.jpg') HTTP/1.1" 204 0
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2ad2b736b534efa543f5c7f33eff0f88.jpg saved to cache
2026-03-28 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0371ffca-6417-5000-9cfe-c3e1707bd28b
2026-03-28 11:35:59 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1819 | hits on page: 40
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd077f390>
2026-03-28 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_0ba3bfcd8b6754c2ef4879ae34d33692.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0ba3bfcd8b6754c2ef4879ae34d33692.jpg saved to cache
2026-03-28 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for UC18604: 1
2026-03-28 11:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd15221d0>
2026-03-28 11:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_a627ed0d82bc3792873aa4bcd4d1b727.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a627ed0d82bc3792873aa4bcd4d1b727.jpg saved to cache
2026-03-28 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for RW32127: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for CE27208: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for CG81228: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for WN54122: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for UA48921: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for RY49845: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for ZT87936: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for VZ26828: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for KR16689: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for YV20290: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for LK52725: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for TS84713: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for HY97997: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for GF35922: 2
2026-03-28 11:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-28 11:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with scrape type 2
2026-03-28 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with scrape type 2
2026-03-28 11:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cba50ece-3db1-5e5e-bc62-65ab11f30ab1, identifier: GF35922
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for TF70513: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for ZD95004: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-28 11:36:00 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-28 11:36:00 [auto1.be] INFO: Scrape type for PC01829: 0
2026-03-28 11:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-28 11:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-28 11:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922 to the API
2026-03-28 11:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'diesel',
 'id': 'cba50ece-3db1-5e5e-bc62-65ab11f30ab1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF35922',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 124830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-19',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2017}
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-28 11:36:01 [auto1.be] INFO: Saving data for GF35922: {'auction_closing_time': 1774883700.0, 'created_time': 1774006547.455712, 'last_price_update_time': 1774697761.197023}
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF35922') HTTP/1.1" 204 0
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_8786f3eaf6779ecebf6f62b6d14eeac0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-28 11:36:01 [auto1.be] INFO: Scrape type for BR73229: 0
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-28 11:36:01 [auto1.be] INFO: Scrape type for BB63081: 0
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-28 11:36:01 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-28 11:36:01 [auto1.be] INFO: Scrape type for XR93319: 0
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-28 11:36:01 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 11:36:01 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-28 11:36:01 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-28 11:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_649376025a7590b3d79c1bcf9242e1e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_4acbe8fca7837e6428777b829abe1ee3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_a964b9977f74a84e966870d073377e51.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0346e0323b236284ac3e308b0dbab965.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd146a590>
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_8786f3eaf6779ecebf6f62b6d14eeac0.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_8786f3eaf6779ecebf6f62b6d14eeac0.jpg saved to cache
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_fe1de5786723d4dc6f8353b2798bf4aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_30329198c45613fd3b32f9b422c9830f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a8f1c35a913c2967d9979a953b0cdc4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1433e10>
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_649376025a7590b3d79c1bcf9242e1e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_649376025a7590b3d79c1bcf9242e1e8.jpg saved to cache
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35d2a10>
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_4acbe8fca7837e6428777b829abe1ee3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_4acbe8fca7837e6428777b829abe1ee3.jpg saved to cache
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04bea10>
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_a964b9977f74a84e966870d073377e51.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_a964b9977f74a84e966870d073377e51.jpg saved to cache
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0984810>
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F4a%252F114a8aff01a85d0aa51385ce91095b17%252Fpa%252FZR35447_0346e0323b236284ac3e308b0dbab965.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0346e0323b236284ac3e308b0dbab965.jpg saved to cache
2026-03-28 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6db941a1-8645-5c6f-bbf7-fe200134479b
2026-03-28 11:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6db941a1-8645-5c6f-bbf7-fe200134479b, skipping ID generation
2026-03-28 11:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db941a1-8645-5c6f-bbf7-fe200134479b with scrape type 1
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6db941a1-8645-5c6f-bbf7-fe200134479b sending to next pipeline
2026-03-28 11:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6db941a1-8645-5c6f-bbf7-fe200134479b, identifier: ZR35447
2026-03-28 11:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_b892bd7e7993c8e6053afebcfad29720.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 11:36:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-28 11:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447 to the API
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0346e0323b236284ac3e308b0dbab965.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:10:19Z',
 'fuel_type': 'petrol',
 'id': '6db941a1-8645-5c6f-bbf7-fe200134479b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR35447',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 75287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3482689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_649376025a7590b3d79c1bcf9242e1e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0b7b717c5d92555beaf46cc66f094bd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3614675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_0346e0323b236284ac3e308b0dbab965.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9c3b10c8f22e3a19febbb7875524e0a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2966002,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_6c2d85e38fd1862dab799a7793df9a90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_ad6e0858a1eb70c7816abc7ec83c5d7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_9641e47e4f45a1e840b10dd6f501689b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2861266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_06629df8ef2707f5120b65e41b0dc5bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3398114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_f43198339518df5130b1101a41d085bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db941a1-8645-5c6f-bbf7-fe200134479b/6db941a1-8645-5c6f-bbf7-fe200134479b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/4a/114a8aff01a85d0aa51385ce91095b17/pa/ZR35447_d7d7728627e7ae3a5caadf428faf11cf.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-28 11:36:02 [auto1.be] INFO: Saving data for ZR35447: {'created_time': 1774697762.611259, 'last_price_update_time': 1774697762.61127, 'auction_closing_time': 1774883419.0}
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR35447') HTTP/1.1" 204 0
2026-03-28 11:36:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08a60d0>
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_fe1de5786723d4dc6f8353b2798bf4aa.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_fe1de5786723d4dc6f8353b2798bf4aa.jpg saved to cache
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13bda10>
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_30329198c45613fd3b32f9b422c9830f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_30329198c45613fd3b32f9b422c9830f.jpg saved to cache
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35d2990>
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_a8f1c35a913c2967d9979a953b0cdc4a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a8f1c35a913c2967d9979a953b0cdc4a.jpg saved to cache
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd3a56550>
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_b892bd7e7993c8e6053afebcfad29720.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_b892bd7e7993c8e6053afebcfad29720.jpg saved to cache
2026-03-28 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0a82427b71b9adae5ad4e1eb2d5e68ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_97dac85e62b4a3fc772e0aa49e56a047.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09d8490>
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_0a82427b71b9adae5ad4e1eb2d5e68ac.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0a82427b71b9adae5ad4e1eb2d5e68ac.jpg saved to cache
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_e45d7a78dc15cc8cbd95b7e2bba299d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08ad6d0>
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_97dac85e62b4a3fc772e0aa49e56a047.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_97dac85e62b4a3fc772e0aa49e56a047.jpg saved to cache
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14f1e10>
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_e45d7a78dc15cc8cbd95b7e2bba299d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_e45d7a78dc15cc8cbd95b7e2bba299d1.jpg saved to cache
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ95673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX50025> (referer: https://www.auto1.com/v1/car-details-view/HX50025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0f064323329c432101445758f53f3a71.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_b3e579110965d8e1cabeeabb31463f8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW85401> (referer: https://www.auto1.com/v1/car-details-view/VW85401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP72448/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV21741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2007a27acf9cb22e5a99f469b166b3dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG16412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-28 11:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with scrape type 1
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_519cdd88fe0545a63416df655e3a4cb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_519cdd88fe0545a63416df655e3a4cb9.jpg not downloaded yet
2026-03-28 11:36:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09db310>
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_0f064323329c432101445758f53f3a71.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0f064323329c432101445758f53f3a71.jpg saved to cache
2026-03-28 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13f4710>
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_b3e579110965d8e1cabeeabb31463f8a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_b3e579110965d8e1cabeeabb31463f8a.jpg saved to cache
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb386063-39c7-587d-ad9a-ff6800bae828
2026-03-28 11:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d926fef6-910b-5432-a36a-00184b952d18 with identifier: VW85401
2026-03-28 11:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d926fef6-910b-5432-a36a-00184b952d18 with scrape type 1
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_0a7161f0f1d00e0582e119b4f3ee0ce0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_0a7161f0f1d00e0582e119b4f3ee0ce0.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_25d2198b68da7bc12258c9a9ffd7b4ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_25d2198b68da7bc12258c9a9ffd7b4ff.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_2c8cfa6d42df9988602bec98944845bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_2c8cfa6d42df9988602bec98944845bc.jpg not downloaded yet
2026-03-28 11:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_3fa09d75810dbc77da427d6dc0ad971c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_f99c0deb3cd4ff8a07fa4185ceb139c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN56944> (referer: https://www.auto1.com/v1/car-details-view/ZN56944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1500890>
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_2007a27acf9cb22e5a99f469b166b3dc.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2007a27acf9cb22e5a99f469b166b3dc.jpg saved to cache
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0371ffca-6417-5000-9cfe-c3e1707bd28b
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_d857e7e12742737a08747f7848ab87b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_d857e7e12742737a08747f7848ab87b9.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_1243eb07c51b7fdd454427d9e82088d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_1243eb07c51b7fdd454427d9e82088d7.jpg not downloaded yet
2026-03-28 11:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_b4fe12d012dc444cacdb12e85de2d350.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_b4fe12d012dc444cacdb12e85de2d350.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_abb43556bb44e0e15df8624ac2e253a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_abb43556bb44e0e15df8624ac2e253a6.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_f0ec273fb25cb0a2ef8d0913e2343fb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_f0ec273fb25cb0a2ef8d0913e2343fb7.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_c9a2c3794d366bdec2787640831bb971.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_c9a2c3794d366bdec2787640831bb971.jpg not downloaded yet
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b57d10>
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_3fa09d75810dbc77da427d6dc0ad971c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_3fa09d75810dbc77da427d6dc0ad971c.jpg saved to cache
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb386063-39c7-587d-ad9a-ff6800bae828
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08e7c90>
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_f99c0deb3cd4ff8a07fa4185ceb139c9.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_f99c0deb3cd4ff8a07fa4185ceb139c9.jpg saved to cache
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-28 11:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cdb666-0057-5970-95f1-d0c19635898b with scrape type 1
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_5e035630922a90d0a63687d7c1bb35a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5e035630922a90d0a63687d7c1bb35a2.jpg not downloaded yet
2026-03-28 11:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_0a7161f0f1d00e0582e119b4f3ee0ce0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_623f6de5a47fdaaf205b8cac5e4c7562.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_623f6de5a47fdaaf205b8cac5e4c7562.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_15385e444f4932ad57fd0c0e2b0fca1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_15385e444f4932ad57fd0c0e2b0fca1c.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_2b4560271913ebe743ae8bc61e26236d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_2b4560271913ebe743ae8bc61e26236d.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_becb9ae2fd46c9e83f07bd0ad902d05e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_becb9ae2fd46c9e83f07bd0ad902d05e.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_d2185454a3c3e95e1ade52960e6b0968.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_d2185454a3c3e95e1ade52960e6b0968.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_31dc28a240bd565be7c4acd641779a25.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_31dc28a240bd565be7c4acd641779a25.jpg not downloaded yet
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_8833cc8b636685914d4ab5cedbf33279.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_8833cc8b636685914d4ab5cedbf33279.jpg not downloaded yet
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09b8550>
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_0a7161f0f1d00e0582e119b4f3ee0ce0.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_0a7161f0f1d00e0582e119b4f3ee0ce0.jpg saved to cache
2026-03-28 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5e035630922a90d0a63687d7c1bb35a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_83b649a7ef56b740e0f77a2195f575bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_83b649a7ef56b740e0f77a2195f575bd.jpg not downloaded yet
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_1eb160abd171a619bbed095f111728a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_1eb160abd171a619bbed095f111728a5.jpg not downloaded yet
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_59e9d5561653fc68894c93bb3f3f0dec.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_59e9d5561653fc68894c93bb3f3f0dec.jpg not downloaded yet
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_88966d29356790d88d409e1db9c22922.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_88966d29356790d88d409e1db9c22922.jpg not downloaded yet
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_a3a84bcc08b3627affa850d98099b924.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_a3a84bcc08b3627affa850d98099b924.jpg not downloaded yet
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_7665c34928e0e5a4c43d75551eafeafa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_7665c34928e0e5a4c43d75551eafeafa.jpg not downloaded yet
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_5fdc37b98d97ab918d37d89e36b1cdbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5fdc37b98d97ab918d37d89e36b1cdbb.jpg not downloaded yet
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a7a410>
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_5e035630922a90d0a63687d7c1bb35a2.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5e035630922a90d0a63687d7c1bb35a2.jpg saved to cache
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_6b3af49cd45da37f030671dd48b54aaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_6b3af49cd45da37f030671dd48b54aaa.jpg not downloaded yet
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_5ad524ce52e7d87ff38fdf063b71c825.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_aebdb07cad503a2ff0528fb6fc5f507e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC18604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_2c8cfa6d42df9988602bec98944845bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_8833cc8b636685914d4ab5cedbf33279.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a35ed0>
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_5ad524ce52e7d87ff38fdf063b71c825.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_5ad524ce52e7d87ff38fdf063b71c825.jpg saved to cache
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_6b3af49cd45da37f030671dd48b54aaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5fdc37b98d97ab918d37d89e36b1cdbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_7665c34928e0e5a4c43d75551eafeafa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC61218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM16327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ63605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0abae50>
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_aebdb07cad503a2ff0528fb6fc5f507e.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_aebdb07cad503a2ff0528fb6fc5f507e.jpg saved to cache
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a88590>
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_2c8cfa6d42df9988602bec98944845bc.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_2c8cfa6d42df9988602bec98944845bc.jpg saved to cache
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:05 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1819 | hits on page: 40
2026-03-28 11:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04cb4d0>
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_8833cc8b636685914d4ab5cedbf33279.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_8833cc8b636685914d4ab5cedbf33279.jpg saved to cache
2026-03-28 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for PX22691: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA79285%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for BA79285: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH21985%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for ZH21985: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX93406%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for WX93406: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU23478%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for TU23478: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH68811%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for NH68811: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK39898%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for SK39898: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY11434%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for NY11434: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE88192%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for XE88192: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55081%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for FU55081: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB14392%27 HTTP/1.1" 200 None
2026-03-28 11:36:05 [auto1.be] INFO: Scrape type for RB14392: 0
2026-03-28 11:36:05 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-28 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY55708%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [auto1.be] INFO: Scrape type for MY55708: 0
2026-03-28 11:36:06 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK15851%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [auto1.be] INFO: Scrape type for XK15851: 0
2026-03-28 11:36:06 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-28 11:36:06 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH53723> (referer: https://www.auto1.com/v1/car-details-view/DH53723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13f5350>
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_6b3af49cd45da37f030671dd48b54aaa.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_6b3af49cd45da37f030671dd48b54aaa.jpg saved to cache
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1548910>
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_5fdc37b98d97ab918d37d89e36b1cdbb.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5fdc37b98d97ab918d37d89e36b1cdbb.jpg saved to cache
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a82a50>
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_7665c34928e0e5a4c43d75551eafeafa.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_7665c34928e0e5a4c43d75551eafeafa.jpg saved to cache
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB31921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-28 11:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20f0804-3982-5a38-b306-11f616ad2e80 with scrape type 1
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_57e0e118c39ab7030615401400c31ada.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_57e0e118c39ab7030615401400c31ada.jpg not downloaded yet
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_175978baf3bec6ef776834ba97b818a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_175978baf3bec6ef776834ba97b818a0.jpg not downloaded yet
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_becb9ae2fd46c9e83f07bd0ad902d05e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_31dc28a240bd565be7c4acd641779a25.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_53a832fbf420a4b89007eba57a535fc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_53a832fbf420a4b89007eba57a535fc8.jpg not downloaded yet
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_a6d9f94797b816b18775badd71609f08.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_a6d9f94797b816b18775badd71609f08.jpg not downloaded yet
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_4ec14fd67f8095e622429f7e1f1f3cb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_4ec14fd67f8095e622429f7e1f1f3cb2.jpg not downloaded yet
2026-03-28 11:36:06 [scrapy.extensions.logstats] INFO: Crawled 103 pages (at 103 pages/min), scraped 38 items (at 38 items/min)
2026-03-28 11:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_52a098785115563eb8a43bd828186a1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_52a098785115563eb8a43bd828186a1f.jpg not downloaded yet
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_d2185454a3c3e95e1ade52960e6b0968.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_79b624d2dc09514b1ff7ac6cae6ebdb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_79b624d2dc09514b1ff7ac6cae6ebdb1.jpg not downloaded yet
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_57e0e118c39ab7030615401400c31ada.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_1eb160abd171a619bbed095f111728a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_d643689b3c0cd3d06e1b3e35d9756988.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_d643689b3c0cd3d06e1b3e35d9756988.jpg not downloaded yet
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_a3a84bcc08b3627affa850d98099b924.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_88966d29356790d88d409e1db9c22922.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB27937> (referer: https://www.auto1.com/v1/car-details-view/MB27937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_9a6586184fbe7861f9338111a12654bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_9a6586184fbe7861f9338111a12654bd.jpg not downloaded yet
2026-03-28 11:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd3f8f290>
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_becb9ae2fd46c9e83f07bd0ad902d05e.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_becb9ae2fd46c9e83f07bd0ad902d05e.jpg saved to cache
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14586d0>
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_31dc28a240bd565be7c4acd641779a25.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_31dc28a240bd565be7c4acd641779a25.jpg saved to cache
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_c10f28044d2b785b4839cbc9b2364728.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_c10f28044d2b785b4839cbc9b2364728.jpg not downloaded yet
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_175978baf3bec6ef776834ba97b818a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK09845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY01361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04876d0>
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_d2185454a3c3e95e1ade52960e6b0968.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_d2185454a3c3e95e1ade52960e6b0968.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1419fd0>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_57e0e118c39ab7030615401400c31ada.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_57e0e118c39ab7030615401400c31ada.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09d9fd0>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_1eb160abd171a619bbed095f111728a5.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_1eb160abd171a619bbed095f111728a5.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04a4890>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_a3a84bcc08b3627affa850d98099b924.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_a3a84bcc08b3627affa850d98099b924.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1520d50>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_88966d29356790d88d409e1db9c22922.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_88966d29356790d88d409e1db9c22922.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73977a7-c4c0-51c2-95f8-c6d084f4e770 with identifier: MB27937
2026-03-28 11:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73977a7-c4c0-51c2-95f8-c6d084f4e770 with scrape type 1
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_47d1a48de1e28eb06a4275683dca0d0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_47d1a48de1e28eb06a4275683dca0d0b.jpg not downloaded yet
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_79b624d2dc09514b1ff7ac6cae6ebdb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_52a098785115563eb8a43bd828186a1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_429579caa0d5bdfca0a47ff2cd6be0a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_429579caa0d5bdfca0a47ff2cd6be0a6.jpg not downloaded yet
2026-03-28 11:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd052a890>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_175978baf3bec6ef776834ba97b818a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_175978baf3bec6ef776834ba97b818a0.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_a538a10f2c4d019c58b5d1dc73509741.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_a538a10f2c4d019c58b5d1dc73509741.jpg not downloaded yet
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_326862e06d89771a61522c09852f27d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_326862e06d89771a61522c09852f27d4.jpg not downloaded yet
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_d643689b3c0cd3d06e1b3e35d9756988.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_4ec14fd67f8095e622429f7e1f1f3cb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_400aab758b1144933c7785d1dcfb5a2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_400aab758b1144933c7785d1dcfb5a2a.jpg not downloaded yet
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_1ee097568a23bed02a25ea25919056ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_1ee097568a23bed02a25ea25919056ff.jpg not downloaded yet
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP72448> (referer: https://www.auto1.com/v1/car-details-view/PP72448/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08f7d90>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_79b624d2dc09514b1ff7ac6cae6ebdb1.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_79b624d2dc09514b1ff7ac6cae6ebdb1.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08f6850>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_52a098785115563eb8a43bd828186a1f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_52a098785115563eb8a43bd828186a1f.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_d8546775ff4e90d84ead960b373db337.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_d8546775ff4e90d84ead960b373db337.jpg not downloaded yet
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_9a6586184fbe7861f9338111a12654bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_c10f28044d2b785b4839cbc9b2364728.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_53a832fbf420a4b89007eba57a535fc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_9745f8e2b91b50a1b69ffd65b4963f66.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_9745f8e2b91b50a1b69ffd65b4963f66.jpg not downloaded yet
2026-03-28 11:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_bcaa1695857a84b534c3890afd7579f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bcaa1695857a84b534c3890afd7579f5.jpg not downloaded yet
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14eea10>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_d643689b3c0cd3d06e1b3e35d9756988.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_d643689b3c0cd3d06e1b3e35d9756988.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 11:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a1d6d0>
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_4ec14fd67f8095e622429f7e1f1f3cb2.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_4ec14fd67f8095e622429f7e1f1f3cb2.jpg saved to cache
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:07 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1819 | hits on page: 40
2026-03-28 11:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-28 11:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with scrape type 1
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_f4d95310ee352caa19921614882067f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_f4d95310ee352caa19921614882067f4.jpg not downloaded yet
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU75132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_bc5bc107a12466ef206e26caff36cc22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bc5bc107a12466ef206e26caff36cc22.jpg not downloaded yet
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA93870%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for TA93870: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF06459%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for JF06459: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ99747%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for PZ99747: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB53896%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for TB53896: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL30549%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for PL30549: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS47676%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for KS47676: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU28222%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for KU28222: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN33262%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for LN33262: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC85996%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for XC85996: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 11:36:07 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_a54311761b40769a37954ea27d0a6478.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_a54311761b40769a37954ea27d0a6478.jpg not downloaded yet
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_83b649a7ef56b740e0f77a2195f575bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_a538a10f2c4d019c58b5d1dc73509741.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_400aab758b1144933c7785d1dcfb5a2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_1ee097568a23bed02a25ea25919056ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC18604> (referer: https://www.auto1.com/v1/car-details-view/UC18604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_0da97a29c2f54ca6a2ee4f62bf0b01ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_0da97a29c2f54ca6a2ee4f62bf0b01ba.jpg not downloaded yet
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13af610>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_9a6586184fbe7861f9338111a12654bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_9a6586184fbe7861f9338111a12654bd.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0928210>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_c10f28044d2b785b4839cbc9b2364728.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_c10f28044d2b785b4839cbc9b2364728.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1418310>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_53a832fbf420a4b89007eba57a535fc8.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_53a832fbf420a4b89007eba57a535fc8.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ63605> (referer: https://www.auto1.com/v1/car-details-view/DJ63605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_59e9d5561653fc68894c93bb3f3f0dec.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_4ed03924a6bbe7c2435f40109ef33da3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4ed03924a6bbe7c2435f40109ef33da3.jpg not downloaded yet
2026-03-28 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB31921> (referer: https://www.auto1.com/v1/car-details-view/EB31921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_f4d95310ee352caa19921614882067f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0aa4f50>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_83b649a7ef56b740e0f77a2195f575bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_83b649a7ef56b740e0f77a2195f575bd.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14e9390>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_a538a10f2c4d019c58b5d1dc73509741.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_a538a10f2c4d019c58b5d1dc73509741.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04dadd0>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_400aab758b1144933c7785d1dcfb5a2a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_400aab758b1144933c7785d1dcfb5a2a.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14e8410>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_1ee097568a23bed02a25ea25919056ff.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_1ee097568a23bed02a25ea25919056ff.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-28 11:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b173c489-7538-5260-a6f8-21e29901460c with scrape type 1
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_d098ba705cdbd4d431bf0eed2d0e8d2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_d098ba705cdbd4d431bf0eed2d0e8d2c.jpg not downloaded yet
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_d62da29d5f18447bf1814a6ab4ba6ca0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_d62da29d5f18447bf1814a6ab4ba6ca0.jpg not downloaded yet
2026-03-28 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bcaa1695857a84b534c3890afd7579f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_9745f8e2b91b50a1b69ffd65b4963f66.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_9a87f7e69d6aeea6f059ccbd752bca88.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9a87f7e69d6aeea6f059ccbd752bca88.jpg not downloaded yet
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_81b4000da0aac053905045cc2da99816.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_81b4000da0aac053905045cc2da99816.jpg not downloaded yet
2026-03-28 11:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-28 11:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with scrape type 1
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_0e5dfd4d2c92922475d506ef7c366098.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_0e5dfd4d2c92922475d506ef7c366098.jpg not downloaded yet
2026-03-28 11:36:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b61e90>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_59e9d5561653fc68894c93bb3f3f0dec.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_59e9d5561653fc68894c93bb3f3f0dec.jpg saved to cache
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-28 11:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70a8686-eefe-5e47-99ce-6b9a88db00f5 with scrape type 1
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b70a8686-eefe-5e47-99ce-6b9a88db00f5
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_6950aa190eca19b9e1401dd7965647c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_6950aa190eca19b9e1401dd7965647c0.jpg not downloaded yet
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ca250>
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_f4d95310ee352caa19921614882067f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_f4d95310ee352caa19921614882067f4.jpg saved to cache
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_22dce8c6e7c7d77ca4c5f8316ea571d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_22dce8c6e7c7d77ca4c5f8316ea571d4.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_4c86f6294a7e6140d5bbaf00ad6690a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4c86f6294a7e6140d5bbaf00ad6690a1.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_48affcf090264e6d45f1cfc114240461.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_48affcf090264e6d45f1cfc114240461.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_581dc83b7395924693abd0c2e68b2b7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_581dc83b7395924693abd0c2e68b2b7a.jpg not downloaded yet
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_a54311761b40769a37954ea27d0a6478.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_9867d945604593ded262e263313ebc9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9867d945604593ded262e263313ebc9a.jpg not downloaded yet
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM16327> (referer: https://www.auto1.com/v1/car-details-view/TM16327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY01361> (referer: https://www.auto1.com/v1/car-details-view/JY01361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK09845> (referer: https://www.auto1.com/v1/car-details-view/FK09845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a89710>
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_bcaa1695857a84b534c3890afd7579f5.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bcaa1695857a84b534c3890afd7579f5.jpg saved to cache
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1385e50>
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_9745f8e2b91b50a1b69ffd65b4963f66.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_9745f8e2b91b50a1b69ffd65b4963f66.jpg saved to cache
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_d62da29d5f18447bf1814a6ab4ba6ca0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_6af71bd9a8fb71706c5561c8a66cfd96.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6af71bd9a8fb71706c5561c8a66cfd96.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_f47bc862ac80f29680b55f3aace3cd80.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_f47bc862ac80f29680b55f3aace3cd80.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_b49d6c22715144a49592422d006fcf7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b49d6c22715144a49592422d006fcf7e.jpg not downloaded yet
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_d098ba705cdbd4d431bf0eed2d0e8d2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_88486a13f6fcaae8c7a5d961921e2b2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_88486a13f6fcaae8c7a5d961921e2b2a.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_6f7bc50405b93d5956beb7adcdae8930.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6f7bc50405b93d5956beb7adcdae8930.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_d960a4b5b3006e10c398aaff976e14eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_d960a4b5b3006e10c398aaff976e14eb.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_37f9dc81141ae62e6cb95dc6c2ddc4c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_37f9dc81141ae62e6cb95dc6c2ddc4c8.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_78eb0384e10c60c42dde6030a7b5d23f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_78eb0384e10c60c42dde6030a7b5d23f.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_e590b3372b3fa01291942340393dc4b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_e590b3372b3fa01291942340393dc4b8.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_027b3ccd521469375e8c3c5d50b22343.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_027b3ccd521469375e8c3c5d50b22343.jpg not downloaded yet
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_b0afbe95b1bd7c0700ed780eac30506e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b0afbe95b1bd7c0700ed780eac30506e.jpg not downloaded yet
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4ed03924a6bbe7c2435f40109ef33da3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_0677b838d3676735368d3b90777c9225.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_0677b838d3676735368d3b90777c9225.jpg not downloaded yet
2026-03-28 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09be390>
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_a54311761b40769a37954ea27d0a6478.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_a54311761b40769a37954ea27d0a6478.jpg saved to cache
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-28 11:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3049ee2d-7293-504a-9175-7f72795d5e40 with scrape type 1
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3049ee2d-7293-504a-9175-7f72795d5e40
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_8eb186cd1ac7cdfa5532c7d9f4535172.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_8eb186cd1ac7cdfa5532c7d9f4535172.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_bc263cb23c0ebd222b1811a9c1ee6d6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_bc263cb23c0ebd222b1811a9c1ee6d6a.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_d3252c3940714aa3432036b3d79eb10c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_d3252c3940714aa3432036b3d79eb10c.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_00af04c061e0bf1fd58926a47a75fa3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_00af04c061e0bf1fd58926a47a75fa3a.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_62a9f2610e883f0a8664557d29c202dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_62a9f2610e883f0a8664557d29c202dc.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_3ef4b3cf6c093c86815246f03f60df2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_3ef4b3cf6c093c86815246f03f60df2c.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_18622d2ba56478764f06fa300e498be8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_18622d2ba56478764f06fa300e498be8.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_edf9ef0d5fae76b502d78585c6307c40.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_edf9ef0d5fae76b502d78585c6307c40.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_1dc5450ae06d880b0950eafc36bb9c81.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_1dc5450ae06d880b0950eafc36bb9c81.jpg already downloaded
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fdb%252F6cdbb6026d06041274c6eae8e29f5d57%252Fpa%252FTM16327_8f04cd9b76811f9432b034488b4250a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_8f04cd9b76811f9432b034488b4250a8.jpg already downloaded
2026-03-28 11:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3049ee2d-7293-504a-9175-7f72795d5e40, identifier: TM16327
2026-03-28 11:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-28 11:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8275dd1c-4360-5681-bf44-7a58ec55484a with scrape type 1
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_4ab61e82bd4ff1bfee834c4af5c6b655.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ab61e82bd4ff1bfee834c4af5c6b655.jpg not downloaded yet
2026-03-28 11:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-28 11:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with scrape type 1
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_09fd00e4f017acab5fbda44f203f9347.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_09fd00e4f017acab5fbda44f203f9347.jpg not downloaded yet
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a0da10>
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_d62da29d5f18447bf1814a6ab4ba6ca0.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_d62da29d5f18447bf1814a6ab4ba6ca0.jpg saved to cache
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bc5bc107a12466ef206e26caff36cc22.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_3c8e3dcb514618530d1c647121a219ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_3c8e3dcb514618530d1c647121a219ed.jpg not downloaded yet
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_5ec7bbd98287a28f3d53c3c1c4ace077.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_5ec7bbd98287a28f3d53c3c1c4ace077.jpg not downloaded yet
2026-03-28 11:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-28 11:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-28 11:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327 to the API
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TM16327>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:05Z',
 'fuel_type': 'diesel',
 'id': '3049ee2d-7293-504a-9175-7f72795d5e40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM16327',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 224368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_8eb186cd1ac7cdfa5532c7d9f4535172.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_bc263cb23c0ebd222b1811a9c1ee6d6a.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_d3252c3940714aa3432036b3d79eb10c.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_00af04c061e0bf1fd58926a47a75fa3a.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_62a9f2610e883f0a8664557d29c202dc.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_3ef4b3cf6c093c86815246f03f60df2c.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_18622d2ba56478764f06fa300e498be8.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_edf9ef0d5fae76b502d78585c6307c40.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_1dc5450ae06d880b0950eafc36bb9c81.jpg',
                'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_8f04cd9b76811f9432b034488b4250a8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_8eb186cd1ac7cdfa5532c7d9f4535172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_bc263cb23c0ebd222b1811a9c1ee6d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_d3252c3940714aa3432036b3d79eb10c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_00af04c061e0bf1fd58926a47a75fa3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_62a9f2610e883f0a8664557d29c202dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_3ef4b3cf6c093c86815246f03f60df2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_18622d2ba56478764f06fa300e498be8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_edf9ef0d5fae76b502d78585c6307c40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_1dc5450ae06d880b0950eafc36bb9c81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3049ee2d-7293-504a-9175-7f72795d5e40/3049ee2d-7293-504a-9175-7f72795d5e40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/db/6cdbb6026d06041274c6eae8e29f5d57/pa/TM16327_8f04cd9b76811f9432b034488b4250a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [auto1.be] INFO: Saving data for TM16327: {'created_time': 1774697770.682946, 'last_price_update_time': 1774697770.682955, 'auction_closing_time': 1774884365.0}
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM16327') HTTP/1.1" 204 0
2026-03-28 11:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_0da97a29c2f54ca6a2ee4f62bf0b01ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_cdc3a1205034906997a2cc539ddc3df1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_cdc3a1205034906997a2cc539ddc3df1.jpg not downloaded yet
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_4ad4dfb05312351ae85dea91a1ffae5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ad4dfb05312351ae85dea91a1ffae5c.jpg not downloaded yet
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_bdd31f80b6f19964a8e3b6c7bb9d7708.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_bdd31f80b6f19964a8e3b6c7bb9d7708.jpg not downloaded yet
2026-03-28 11:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU75132> (referer: https://www.auto1.com/v1/car-details-view/EU75132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08e7090>
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_d098ba705cdbd4d431bf0eed2d0e8d2c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_d098ba705cdbd4d431bf0eed2d0e8d2c.jpg saved to cache
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_cba733af5b0690b2e70aad4028778106.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_cba733af5b0690b2e70aad4028778106.jpg not downloaded yet
2026-03-28 11:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_22dce8c6e7c7d77ca4c5f8316ea571d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_ee83804dd8f597fba16d7d9efdaf36d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_ee83804dd8f597fba16d7d9efdaf36d4.jpg not downloaded yet
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_262e14a343a42c29e61e938e7a239167.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_262e14a343a42c29e61e938e7a239167.jpg not downloaded yet
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_83ff62d489f5c9bdd31d0fea8cac677d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_83ff62d489f5c9bdd31d0fea8cac677d.jpg not downloaded yet
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0525690>
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_4ed03924a6bbe7c2435f40109ef33da3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4ed03924a6bbe7c2435f40109ef33da3.jpg saved to cache
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:11 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1819 | hits on page: 40
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04cb610>
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_bc5bc107a12466ef206e26caff36cc22.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bc5bc107a12466ef206e26caff36cc22.jpg saved to cache
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_e9d6aff97ede662af4c5c9f579bd700d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_e9d6aff97ede662af4c5c9f579bd700d.jpg not downloaded yet
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b6a750>
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_0da97a29c2f54ca6a2ee4f62bf0b01ba.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_0da97a29c2f54ca6a2ee4f62bf0b01ba.jpg saved to cache
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_581dc83b7395924693abd0c2e68b2b7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_530e6e84aa241a8d6b385ddd416ab7e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_530e6e84aa241a8d6b385ddd416ab7e2.jpg not downloaded yet
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_a7900c51e1d4f4885de3c4d6cb895cf1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_a7900c51e1d4f4885de3c4d6cb895cf1.jpg not downloaded yet
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_a5c27e450aa504e3a589cc6f6ded1972.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a5c27e450aa504e3a589cc6f6ded1972.jpg not downloaded yet
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ92638%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for EZ92638: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68139%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for GM68139: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56450%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for CW56450: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44926%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for UA44926: 0
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-28 11:36:11 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [auto1.be] INFO: Scrape type for NS97708: 2
2026-03-28 11:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-28 11:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817f1743-ff77-5064-a9cd-4dc974ab4f4b with scrape type 2
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817f1743-ff77-5064-a9cd-4dc974ab4f4b with scrape type 2
2026-03-28 11:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 817f1743-ff77-5064-a9cd-4dc974ab4f4b, identifier: NS97708
2026-03-28 11:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_48affcf090264e6d45f1cfc114240461.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_a5a7aedf7b74d4dba569d315297b6596.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_a5a7aedf7b74d4dba569d315297b6596.jpg not downloaded yet
2026-03-28 11:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-28 11:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-28 11:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708 to the API
2026-03-28 11:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:31:51Z',
 'fuel_type': 'petrol',
 'id': '817f1743-ff77-5064-a9cd-4dc974ab4f4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS97708',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-26',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Night and Day',
 'transmission': 'manual',
 'trim': 'Night and Day',
 'year': 2010}
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [auto1.be] INFO: Saving data for NS97708: {'auction_closing_time': 1774715511.0, 'created_time': 1774514158.29556, 'last_price_update_time': 1774697772.425628}
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS97708') HTTP/1.1" 204 0
2026-03-28 11:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-28 11:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866a5601-cd8e-5d41-9c03-ee135e528231 with scrape type 1
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 866a5601-cd8e-5d41-9c03-ee135e528231
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_b6a298ed1c44ce2d5ab0072b94935d3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_b6a298ed1c44ce2d5ab0072b94935d3b.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_ca5f057ab64f1ce28b93a91a6ab14a9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_ca5f057ab64f1ce28b93a91a6ab14a9e.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_999409dc2874a57073e1eb7539a655a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_999409dc2874a57073e1eb7539a655a5.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_7f0b377436d6cc12a31bbc6bd9efaeab.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_7f0b377436d6cc12a31bbc6bd9efaeab.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_05f99661403052afbf5a4dfbee383f4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_05f99661403052afbf5a4dfbee383f4d.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_043bbc715127816adb44ff148d246a50.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_043bbc715127816adb44ff148d246a50.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_1cea691bf03f517eceabac145271d591.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_1cea691bf03f517eceabac145271d591.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_5c16ee07b910069a1266c32a15da49cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_5c16ee07b910069a1266c32a15da49cc.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_4bf05084913adf29fcd6eb23d4c423b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_4bf05084913adf29fcd6eb23d4c423b2.jpg already downloaded
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F3b%252F613b758f3dc2b0612ae823382f28940a%252Fpa%252FEU75132_ed2ac4c81363ecc5dca8b74023929450.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_ed2ac4c81363ecc5dca8b74023929450.jpg already downloaded
2026-03-28 11:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 866a5601-cd8e-5d41-9c03-ee135e528231, identifier: EU75132
2026-03-28 11:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13bef10>
2026-03-28 11:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_22dce8c6e7c7d77ca4c5f8316ea571d4.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_22dce8c6e7c7d77ca4c5f8316ea571d4.jpg saved to cache
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4c86f6294a7e6140d5bbaf00ad6690a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_1904a609e36f696d7c53b35c2f21a683.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_1904a609e36f696d7c53b35c2f21a683.jpg not downloaded yet
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_551f2ae15b3fe3d16392d9ef167925ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_551f2ae15b3fe3d16392d9ef167925ba.jpg not downloaded yet
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [auto1.be] INFO: Scrape type for YS75558: 0
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ37303%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [auto1.be] INFO: Scrape type for PJ37303: 0
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [auto1.be] INFO: Scrape type for LM02594: 0
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL48181%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [auto1.be] INFO: Scrape type for ZL48181: 0
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS64524%27 HTTP/1.1" 200 None
2026-03-28 11:36:12 [auto1.be] INFO: Scrape type for WS64524: 0
2026-03-28 11:36:12 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 11:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-28 11:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-28 11:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132 to the API
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EU75132>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:40:06Z',
 'fuel_type': 'diesel',
 'id': '866a5601-cd8e-5d41-9c03-ee135e528231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU75132',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 199855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_b6a298ed1c44ce2d5ab0072b94935d3b.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_ca5f057ab64f1ce28b93a91a6ab14a9e.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_999409dc2874a57073e1eb7539a655a5.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_7f0b377436d6cc12a31bbc6bd9efaeab.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_05f99661403052afbf5a4dfbee383f4d.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_043bbc715127816adb44ff148d246a50.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_1cea691bf03f517eceabac145271d591.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_5c16ee07b910069a1266c32a15da49cc.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_4bf05084913adf29fcd6eb23d4c423b2.jpg',
                'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_ed2ac4c81363ecc5dca8b74023929450.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51910,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_b6a298ed1c44ce2d5ab0072b94935d3b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48784,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_ca5f057ab64f1ce28b93a91a6ab14a9e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42407,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_999409dc2874a57073e1eb7539a655a5.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39136,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_7f0b377436d6cc12a31bbc6bd9efaeab.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40159,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_05f99661403052afbf5a4dfbee383f4d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46215,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_043bbc715127816adb44ff148d246a50.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40435,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_1cea691bf03f517eceabac145271d591.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49658,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_5c16ee07b910069a1266c32a15da49cc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46327,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_4bf05084913adf29fcd6eb23d4c423b2.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_866a5601-cd8e-5d41-9c03-ee135e528231/866a5601-cd8e-5d41-9c03-ee135e528231_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37503,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/3b/613b758f3dc2b0612ae823382f28940a/pa/EU75132_ed2ac4c81363ecc5dca8b74023929450.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [auto1.be] INFO: Saving data for EU75132: {'created_time': 1774697773.307018, 'last_price_update_time': 1774697773.307027, 'auction_closing_time': 1774885206.0}
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU75132') HTTP/1.1" 204 0
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_b28f3cd645d8ef2ae2ec87a41987af1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_b28f3cd645d8ef2ae2ec87a41987af1c.jpg not downloaded yet
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0487610>
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_581dc83b7395924693abd0c2e68b2b7a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_581dc83b7395924693abd0c2e68b2b7a.jpg saved to cache
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b70a8686-eefe-5e47-99ce-6b9a88db00f5
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_6950aa190eca19b9e1401dd7965647c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_ea1bc02f4c9d28745593e869a3fc8621.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_ea1bc02f4c9d28745593e869a3fc8621.jpg not downloaded yet
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_a620c6db1923aca4599c574d094c040f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a620c6db1923aca4599c574d094c040f.jpg not downloaded yet
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d1850>
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_48affcf090264e6d45f1cfc114240461.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_48affcf090264e6d45f1cfc114240461.jpg saved to cache
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b49d6c22715144a49592422d006fcf7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd047a810>
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_4c86f6294a7e6140d5bbaf00ad6690a1.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4c86f6294a7e6140d5bbaf00ad6690a1.jpg saved to cache
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_f9e7c2b3b853450f791cd3b70f6e867f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_f9e7c2b3b853450f791cd3b70f6e867f.jpg not downloaded yet
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_ce2d71dec186e42a4e5faa0244bee83f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_ce2d71dec186e42a4e5faa0244bee83f.jpg not downloaded yet
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_47d1a48de1e28eb06a4275683dca0d0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_326862e06d89771a61522c09852f27d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_09fd00e4f017acab5fbda44f203f9347.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_e77705d685ba72fdd0de9284d7ec5ef3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_e77705d685ba72fdd0de9284d7ec5ef3.jpg not downloaded yet
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_f4a8e6ab7ab0e0e56e8a4a1935882d99.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_f4a8e6ab7ab0e0e56e8a4a1935882d99.jpg not downloaded yet
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd32d3210>
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_6950aa190eca19b9e1401dd7965647c0.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_6950aa190eca19b9e1401dd7965647c0.jpg saved to cache
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b70a8686-eefe-5e47-99ce-6b9a88db00f5
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_78eb0384e10c60c42dde6030a7b5d23f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ab61e82bd4ff1bfee834c4af5c6b655.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_509ba5679bea5e2d90a8871e949eb94c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_509ba5679bea5e2d90a8871e949eb94c.jpg not downloaded yet
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_dec21343dcf325a2e2853080c9077397.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_dec21343dcf325a2e2853080c9077397.jpg not downloaded yet
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_5ec7bbd98287a28f3d53c3c1c4ace077.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_039fe88b8b37405942c868b467a39303.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_039fe88b8b37405942c868b467a39303.jpg not downloaded yet
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_2fb6ff6cd7b2676bc91744b5f5e1e645.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_2fb6ff6cd7b2676bc91744b5f5e1e645.jpg not downloaded yet
2026-03-28 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_a6d9f94797b816b18775badd71609f08.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a32cd0>
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_b49d6c22715144a49592422d006fcf7e.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b49d6c22715144a49592422d006fcf7e.jpg saved to cache
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b70a8686-eefe-5e47-99ce-6b9a88db00f5
2026-03-28 11:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0916010>
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_47d1a48de1e28eb06a4275683dca0d0b.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_47d1a48de1e28eb06a4275683dca0d0b.jpg saved to cache
2026-03-28 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09b4790>
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_326862e06d89771a61522c09852f27d4.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_326862e06d89771a61522c09852f27d4.jpg saved to cache
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14e9310>
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_09fd00e4f017acab5fbda44f203f9347.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_09fd00e4f017acab5fbda44f203f9347.jpg saved to cache
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_e9d6aff97ede662af4c5c9f579bd700d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_bdd31f80b6f19964a8e3b6c7bb9d7708.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a5c27e450aa504e3a589cc6f6ded1972.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14ea050>
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_78eb0384e10c60c42dde6030a7b5d23f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_78eb0384e10c60c42dde6030a7b5d23f.jpg saved to cache
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a0c750>
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_4ab61e82bd4ff1bfee834c4af5c6b655.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ab61e82bd4ff1bfee834c4af5c6b655.jpg saved to cache
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd097c1d0>
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_5ec7bbd98287a28f3d53c3c1c4ace077.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_5ec7bbd98287a28f3d53c3c1c4ace077.jpg saved to cache
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b70a8686-eefe-5e47-99ce-6b9a88db00f5
2026-03-28 11:36:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1560c50>
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F31%252Fce317883ca491c923b4e09eb8e8ca08a%252Fpa%252FDH53723_a6d9f94797b816b18775badd71609f08.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_a6d9f94797b816b18775badd71609f08.jpg saved to cache
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b20f0804-3982-5a38-b306-11f616ad2e80
2026-03-28 11:36:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b20f0804-3982-5a38-b306-11f616ad2e80, skipping ID generation
2026-03-28 11:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20f0804-3982-5a38-b306-11f616ad2e80 with scrape type 1
2026-03-28 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b20f0804-3982-5a38-b306-11f616ad2e80 sending to next pipeline
2026-03-28 11:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b20f0804-3982-5a38-b306-11f616ad2e80, identifier: DH53723
2026-03-28 11:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-28 11:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-28 11:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723 to the API
2026-03-28 11:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_a6d9f94797b816b18775badd71609f08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:08:30Z',
 'fuel_type': 'diesel',
 'id': 'b20f0804-3982-5a38-b306-11f616ad2e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH53723',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 129982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_57e0e118c39ab7030615401400c31ada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_175978baf3bec6ef776834ba97b818a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_53a832fbf420a4b89007eba57a535fc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941907,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_a6d9f94797b816b18775badd71609f08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_4ec14fd67f8095e622429f7e1f1f3cb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_52a098785115563eb8a43bd828186a1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_79b624d2dc09514b1ff7ac6cae6ebdb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_d643689b3c0cd3d06e1b3e35d9756988.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_9a6586184fbe7861f9338111a12654bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20f0804-3982-5a38-b306-11f616ad2e80/b20f0804-3982-5a38-b306-11f616ad2e80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/31/ce317883ca491c923b4e09eb8e8ca08a/pa/DH53723_c10f28044d2b785b4839cbc9b2364728.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2019}
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Saving data for DH53723: {'created_time': 1774697776.373988, 'last_price_update_time': 1774697776.374001, 'auction_closing_time': 1774883310.0}
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH53723') HTTP/1.1" 204 0
2026-03-28 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_d8546775ff4e90d84ead960b373db337.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_ce2d71dec186e42a4e5faa0244bee83f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a620c6db1923aca4599c574d094c040f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_ea1bc02f4c9d28745593e869a3fc8621.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14fb390>
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_e9d6aff97ede662af4c5c9f579bd700d.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_e9d6aff97ede662af4c5c9f579bd700d.jpg saved to cache
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13c9650>
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_bdd31f80b6f19964a8e3b6c7bb9d7708.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_bdd31f80b6f19964a8e3b6c7bb9d7708.jpg saved to cache
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ea190>
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_a5c27e450aa504e3a589cc6f6ded1972.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a5c27e450aa504e3a589cc6f6ded1972.jpg saved to cache
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_429579caa0d5bdfca0a47ff2cd6be0a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd32c4110>
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_d8546775ff4e90d84ead960b373db337.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_d8546775ff4e90d84ead960b373db337.jpg saved to cache
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a32090>
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_ce2d71dec186e42a4e5faa0244bee83f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_ce2d71dec186e42a4e5faa0244bee83f.jpg saved to cache
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08e0b90>
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_a620c6db1923aca4599c574d094c040f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a620c6db1923aca4599c574d094c040f.jpg saved to cache
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d27d0>
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_ea1bc02f4c9d28745593e869a3fc8621.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_ea1bc02f4c9d28745593e869a3fc8621.jpg saved to cache
2026-03-28 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:16 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1819 | hits on page: 40
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for MH10936: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for PB88221: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY53321%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for ZY53321: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN14983%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for AN14983: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY60433%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for KY60433: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV88346%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for YV88346: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX76756%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for SX76756: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN79459%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for UN79459: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD83049%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for RD83049: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64261%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for UE64261: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA02413%27 HTTP/1.1" 200 None
2026-03-28 11:36:16 [auto1.be] INFO: Scrape type for UA02413: 0
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 11:36:16 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-28 11:36:17 [auto1.be] INFO: Scrape type for PL33803: 0
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-28 11:36:17 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-28 11:36:17 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR59169%27 HTTP/1.1" 200 None
2026-03-28 11:36:17 [auto1.be] INFO: Scrape type for GR59169: 0
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-28 11:36:17 [auto1.be] INFO: Scrape type for CD50328: 0
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU62289%27 HTTP/1.1" 200 None
2026-03-28 11:36:17 [auto1.be] INFO: Scrape type for EU62289: 0
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-28 11:36:17 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-28 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_039fe88b8b37405942c868b467a39303.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_509ba5679bea5e2d90a8871e949eb94c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_dec21343dcf325a2e2853080c9077397.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08e1ad0>
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fa3%252F00a3be980cacd076c40e9b9c0427ef99%252Fpa%252FMB27937_429579caa0d5bdfca0a47ff2cd6be0a6.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_429579caa0d5bdfca0a47ff2cd6be0a6.jpg saved to cache
2026-03-28 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f73977a7-c4c0-51c2-95f8-c6d084f4e770
2026-03-28 11:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f73977a7-c4c0-51c2-95f8-c6d084f4e770, skipping ID generation
2026-03-28 11:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73977a7-c4c0-51c2-95f8-c6d084f4e770 with scrape type 1
2026-03-28 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f73977a7-c4c0-51c2-95f8-c6d084f4e770 sending to next pipeline
2026-03-28 11:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f73977a7-c4c0-51c2-95f8-c6d084f4e770, identifier: MB27937
2026-03-28 11:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f73977a7-c4c0-51c2-95f8-c6d084f4e770 with identifier: MB27937
2026-03-28 11:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f73977a7-c4c0-51c2-95f8-c6d084f4e770 with identifier: MB27937
2026-03-28 11:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f73977a7-c4c0-51c2-95f8-c6d084f4e770 with identifier: MB27937 to the API
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_429579caa0d5bdfca0a47ff2cd6be0a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:21:11Z',
 'fuel_type': 'diesel',
 'id': 'f73977a7-c4c0-51c2-95f8-c6d084f4e770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB27937',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 69206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388356,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_47d1a48de1e28eb06a4275683dca0d0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452038,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_429579caa0d5bdfca0a47ff2cd6be0a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_a538a10f2c4d019c58b5d1dc73509741.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2295916,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_326862e06d89771a61522c09852f27d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_400aab758b1144933c7785d1dcfb5a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_1ee097568a23bed02a25ea25919056ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2523974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_d8546775ff4e90d84ead960b373db337.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_9745f8e2b91b50a1b69ffd65b4963f66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bcaa1695857a84b534c3890afd7579f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f73977a7-c4c0-51c2-95f8-c6d084f4e770/f73977a7-c4c0-51c2-95f8-c6d084f4e770_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/a3/00a3be980cacd076c40e9b9c0427ef99/pa/MB27937_bc5bc107a12466ef206e26caff36cc22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB27937%27 HTTP/1.1" 200 None
2026-03-28 11:36:17 [auto1.be] INFO: Saving data for MB27937: {'created_time': 1774697777.809177, 'last_price_update_time': 1774697777.809187, 'auction_closing_time': 1774884071.0}
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB27937') HTTP/1.1" 204 0
2026-03-28 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_e77705d685ba72fdd0de9284d7ec5ef3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_f9e7c2b3b853450f791cd3b70f6e867f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a2d2d0>
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_039fe88b8b37405942c868b467a39303.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_039fe88b8b37405942c868b467a39303.jpg saved to cache
2026-03-28 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b5d450>
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_509ba5679bea5e2d90a8871e949eb94c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_509ba5679bea5e2d90a8871e949eb94c.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0930d10>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_dec21343dcf325a2e2853080c9077397.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_dec21343dcf325a2e2853080c9077397.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08bce90>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_e77705d685ba72fdd0de9284d7ec5ef3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_e77705d685ba72fdd0de9284d7ec5ef3.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09ff650>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_f9e7c2b3b853450f791cd3b70f6e867f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_f9e7c2b3b853450f791cd3b70f6e867f.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_1904a609e36f696d7c53b35c2f21a683.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_0677b838d3676735368d3b90777c9225.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_a5a7aedf7b74d4dba569d315297b6596.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_b28f3cd645d8ef2ae2ec87a41987af1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_551f2ae15b3fe3d16392d9ef167925ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_f4a8e6ab7ab0e0e56e8a4a1935882d99.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_2fb6ff6cd7b2676bc91744b5f5e1e645.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_530e6e84aa241a8d6b385ddd416ab7e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_a7900c51e1d4f4885de3c4d6cb895cf1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13f7dd0>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_1904a609e36f696d7c53b35c2f21a683.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_1904a609e36f696d7c53b35c2f21a683.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd077f110>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_0677b838d3676735368d3b90777c9225.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_0677b838d3676735368d3b90777c9225.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04edc10>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_a5a7aedf7b74d4dba569d315297b6596.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_a5a7aedf7b74d4dba569d315297b6596.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1397f10>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_b28f3cd645d8ef2ae2ec87a41987af1c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_b28f3cd645d8ef2ae2ec87a41987af1c.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1394210>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_551f2ae15b3fe3d16392d9ef167925ba.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_551f2ae15b3fe3d16392d9ef167925ba.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd146d3d0>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_f4a8e6ab7ab0e0e56e8a4a1935882d99.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_f4a8e6ab7ab0e0e56e8a4a1935882d99.jpg saved to cache
2026-03-28 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd3336f90>
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_2fb6ff6cd7b2676bc91744b5f5e1e645.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_2fb6ff6cd7b2676bc91744b5f5e1e645.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09307d0>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_530e6e84aa241a8d6b385ddd416ab7e2.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_530e6e84aa241a8d6b385ddd416ab7e2.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_3c8e3dcb514618530d1c647121a219ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_262e14a343a42c29e61e938e7a239167.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b0afbe95b1bd7c0700ed780eac30506e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ae2210>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_a7900c51e1d4f4885de3c4d6cb895cf1.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_a7900c51e1d4f4885de3c4d6cb895cf1.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_cdc3a1205034906997a2cc539ddc3df1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_ee83804dd8f597fba16d7d9efdaf36d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_cba733af5b0690b2e70aad4028778106.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_83ff62d489f5c9bdd31d0fea8cac677d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ad4dfb05312351ae85dea91a1ffae5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0910910>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_3c8e3dcb514618530d1c647121a219ed.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_3c8e3dcb514618530d1c647121a219ed.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_88486a13f6fcaae8c7a5d961921e2b2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d2150>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_262e14a343a42c29e61e938e7a239167.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_262e14a343a42c29e61e938e7a239167.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d39d0>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_b0afbe95b1bd7c0700ed780eac30506e.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b0afbe95b1bd7c0700ed780eac30506e.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b70a8686-eefe-5e47-99ce-6b9a88db00f5
2026-03-28 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_027b3ccd521469375e8c3c5d50b22343.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a8b310>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_cdc3a1205034906997a2cc539ddc3df1.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_cdc3a1205034906997a2cc539ddc3df1.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd046d4d0>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_ee83804dd8f597fba16d7d9efdaf36d4.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_ee83804dd8f597fba16d7d9efdaf36d4.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0498750>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_cba733af5b0690b2e70aad4028778106.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_cba733af5b0690b2e70aad4028778106.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b6f2d0>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F1d%252Fa81dcb7840ee40b6b513e96daabe6dfa%252Fpa%252FFK09845_83ff62d489f5c9bdd31d0fea8cac677d.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_83ff62d489f5c9bdd31d0fea8cac677d.jpg saved to cache
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6
2026-03-28 11:36:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6, skipping ID generation
2026-03-28 11:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with scrape type 1
2026-03-28 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 sending to next pipeline
2026-03-28 11:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6, identifier: FK09845
2026-03-28 11:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08befd0>
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Ffa%252F07fa2db6acb480fd9f96f8ce1a2529f5%252Fpa%252FJY01361_4ad4dfb05312351ae85dea91a1ffae5c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ad4dfb05312351ae85dea91a1ffae5c.jpg saved to cache
2026-03-28 11:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8275dd1c-4360-5681-bf44-7a58ec55484a
2026-03-28 11:36:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8275dd1c-4360-5681-bf44-7a58ec55484a, skipping ID generation
2026-03-28 11:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8275dd1c-4360-5681-bf44-7a58ec55484a with scrape type 1
2026-03-28 11:36:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8275dd1c-4360-5681-bf44-7a58ec55484a sending to next pipeline
2026-03-28 11:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8275dd1c-4360-5681-bf44-7a58ec55484a, identifier: JY01361
2026-03-28 11:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-28 11:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-28 11:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845 to the API
2026-03-28 11:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_83ff62d489f5c9bdd31d0fea8cac677d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:35:45Z',
 'fuel_type': 'petrol',
 'id': 'c70a5763-970e-5a4e-bb73-d1ba5c51d2d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK09845',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_09fd00e4f017acab5fbda44f203f9347.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_bdd31f80b6f19964a8e3b6c7bb9d7708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3140658,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_83ff62d489f5c9bdd31d0fea8cac677d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a5c27e450aa504e3a589cc6f6ded1972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_551f2ae15b3fe3d16392d9ef167925ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_a620c6db1923aca4599c574d094c040f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_ce2d71dec186e42a4e5faa0244bee83f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_f4a8e6ab7ab0e0e56e8a4a1935882d99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_dec21343dcf325a2e2853080c9077397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70a5763-970e-5a4e-bb73-d1ba5c51d2d6/c70a5763-970e-5a4e-bb73-d1ba5c51d2d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3281724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/1d/a81dcb7840ee40b6b513e96daabe6dfa/pa/FK09845_2fb6ff6cd7b2676bc91744b5f5e1e645.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-28 11:36:21 [auto1.be] INFO: Saving data for FK09845: {'created_time': 1774697781.210376, 'last_price_update_time': 1774697781.210388, 'auction_closing_time': 1774884945.0}
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK09845') HTTP/1.1" 204 0
2026-03-28 11:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-28 11:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-28 11:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361 to the API
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ad4dfb05312351ae85dea91a1ffae5c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:32Z',
 'fuel_type': 'diesel',
 'id': '8275dd1c-4360-5681-bf44-7a58ec55484a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY01361',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 136779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ab61e82bd4ff1bfee834c4af5c6b655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3375525,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_4ad4dfb05312351ae85dea91a1ffae5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_262e14a343a42c29e61e938e7a239167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_a7900c51e1d4f4885de3c4d6cb895cf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_1904a609e36f696d7c53b35c2f21a683.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_ea1bc02f4c9d28745593e869a3fc8621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_f9e7c2b3b853450f791cd3b70f6e867f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_e77705d685ba72fdd0de9284d7ec5ef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_509ba5679bea5e2d90a8871e949eb94c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8275dd1c-4360-5681-bf44-7a58ec55484a/8275dd1c-4360-5681-bf44-7a58ec55484a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/fa/07fa2db6acb480fd9f96f8ce1a2529f5/pa/JY01361_039fe88b8b37405942c868b467a39303.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-28 11:36:21 [auto1.be] INFO: Saving data for JY01361: {'created_time': 1774697781.569314, 'last_price_update_time': 1774697781.569324, 'auction_closing_time': 1774883252.0}
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY01361') HTTP/1.1" 204 0
2026-03-28 11:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_e590b3372b3fa01291942340393dc4b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_37f9dc81141ae62e6cb95dc6c2ddc4c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_0e5dfd4d2c92922475d506ef7c366098.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13ae410>
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_88486a13f6fcaae8c7a5d961921e2b2a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_88486a13f6fcaae8c7a5d961921e2b2a.jpg saved to cache
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b62790>
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_027b3ccd521469375e8c3c5d50b22343.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_027b3ccd521469375e8c3c5d50b22343.jpg saved to cache
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9a87f7e69d6aeea6f059ccbd752bca88.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1555150>
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_e590b3372b3fa01291942340393dc4b8.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_e590b3372b3fa01291942340393dc4b8.jpg saved to cache
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14eab10>
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5c%252F6a5c9ed013b7ab9327a7274be65f7619%252Fpa%252FEB31921_37f9dc81141ae62e6cb95dc6c2ddc4c8.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_37f9dc81141ae62e6cb95dc6c2ddc4c8.jpg saved to cache
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b70a8686-eefe-5e47-99ce-6b9a88db00f5
2026-03-28 11:36:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b70a8686-eefe-5e47-99ce-6b9a88db00f5, skipping ID generation
2026-03-28 11:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70a8686-eefe-5e47-99ce-6b9a88db00f5 with scrape type 1
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b70a8686-eefe-5e47-99ce-6b9a88db00f5 sending to next pipeline
2026-03-28 11:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b70a8686-eefe-5e47-99ce-6b9a88db00f5, identifier: EB31921
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd052b550>
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_0e5dfd4d2c92922475d506ef7c366098.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_0e5dfd4d2c92922475d506ef7c366098.jpg saved to cache
2026-03-28 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-28 11:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-28 11:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921 to the API
2026-03-28 11:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_37f9dc81141ae62e6cb95dc6c2ddc4c8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:13:52Z',
 'fuel_type': 'diesel',
 'id': 'b70a8686-eefe-5e47-99ce-6b9a88db00f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB31921',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 224762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_6950aa190eca19b9e1401dd7965647c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_581dc83b7395924693abd0c2e68b2b7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b49d6c22715144a49592422d006fcf7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_37f9dc81141ae62e6cb95dc6c2ddc4c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_b0afbe95b1bd7c0700ed780eac30506e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70a8686-eefe-5e47-99ce-6b9a88db00f5/b70a8686-eefe-5e47-99ce-6b9a88db00f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/5c/6a5c9ed013b7ab9327a7274be65f7619/pa/EB31921_5ec7bbd98287a28f3d53c3c1c4ace077.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.4 CRDi Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Saving data for EB31921: {'created_time': 1774697782.226079, 'last_price_update_time': 1774697782.226088, 'auction_closing_time': 1774883632.0}
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB31921') HTTP/1.1" 204 0
2026-03-28 11:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_2b4560271913ebe743ae8bc61e26236d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_15385e444f4932ad57fd0c0e2b0fca1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_81b4000da0aac053905045cc2da99816.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:22 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1819 | hits on page: 40
2026-03-28 11:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd21d7310>
2026-03-28 11:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_9a87f7e69d6aeea6f059ccbd752bca88.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9a87f7e69d6aeea6f059ccbd752bca88.jpg saved to cache
2026-03-28 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF40273%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for YF40273: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH30418%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for KH30418: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX63098%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for KX63098: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK71488%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for CK71488: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR44504%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for MR44504: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU20603%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for BU20603: 0
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-28 11:36:22 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-28 11:36:22 [auto1.be] INFO: Scrape type for LT82149: 2
2026-03-28 11:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149
2026-03-28 11:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with scrape type 2
2026-03-28 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with scrape type 2
2026-03-28 11:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3, identifier: LT82149
2026-03-28 11:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC61218> (referer: https://www.auto1.com/v1/car-details-view/TC61218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149
2026-03-28 11:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149
2026-03-28 11:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3 with identifier: LT82149 to the API
2026-03-28 11:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:34:59Z',
 'fuel_type': 'petrol',
 'id': '22d6c8af-d05c-55b6-a0a4-ea0636c3d1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT82149',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 67628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-28 11:36:23 [auto1.be] INFO: Saving data for LT82149: {'auction_closing_time': 1774715699.0, 'created_time': 1774514143.724477, 'last_price_update_time': 1774697783.135376}
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT82149') HTTP/1.1" 204 0
2026-03-28 11:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF99667%27 HTTP/1.1" 200 None
2026-03-28 11:36:23 [auto1.be] INFO: Scrape type for VF99667: 0
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-28 11:36:23 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF90058%27 HTTP/1.1" 200 None
2026-03-28 11:36:23 [auto1.be] INFO: Scrape type for XF90058: 0
2026-03-28 11:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_c9a2c3794d366bdec2787640831bb971.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_623f6de5a47fdaaf205b8cac5e4c7562.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_f0ec273fb25cb0a2ef8d0913e2343fb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1556590>
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F72%252Fb7724ff1fe5a505d6382a063f3c9af76%252Fpa%252FZN56944_2b4560271913ebe743ae8bc61e26236d.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_2b4560271913ebe743ae8bc61e26236d.jpg saved to cache
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36cdb666-0057-5970-95f1-d0c19635898b
2026-03-28 11:36:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36cdb666-0057-5970-95f1-d0c19635898b, skipping ID generation
2026-03-28 11:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cdb666-0057-5970-95f1-d0c19635898b with scrape type 1
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36cdb666-0057-5970-95f1-d0c19635898b sending to next pipeline
2026-03-28 11:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 36cdb666-0057-5970-95f1-d0c19635898b, identifier: ZN56944
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd3320450>
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_15385e444f4932ad57fd0c0e2b0fca1c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_15385e444f4932ad57fd0c0e2b0fca1c.jpg saved to cache
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1424750>
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_81b4000da0aac053905045cc2da99816.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_81b4000da0aac053905045cc2da99816.jpg saved to cache
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-28 11:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with scrape type 1
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_efccbbb2e123af47627239c041b1ab01.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_efccbbb2e123af47627239c041b1ab01.jpg not downloaded yet
2026-03-28 11:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-28 11:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-28 11:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944 to the API
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_2b4560271913ebe743ae8bc61e26236d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:11Z',
 'fuel_type': 'diesel',
 'id': '36cdb666-0057-5970-95f1-d0c19635898b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN56944',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 148676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5e035630922a90d0a63687d7c1bb35a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_2b4560271913ebe743ae8bc61e26236d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_d2185454a3c3e95e1ade52960e6b0968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2496082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_8833cc8b636685914d4ab5cedbf33279.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_1eb160abd171a619bbed095f111728a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_88966d29356790d88d409e1db9c22922.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_a3a84bcc08b3627affa850d98099b924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_7665c34928e0e5a4c43d75551eafeafa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_5fdc37b98d97ab918d37d89e36b1cdbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36cdb666-0057-5970-95f1-d0c19635898b/36cdb666-0057-5970-95f1-d0c19635898b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/72/b7724ff1fe5a505d6382a063f3c9af76/pa/ZN56944_6b3af49cd45da37f030671dd48b54aaa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-28 11:36:23 [auto1.be] INFO: Saving data for ZN56944: {'created_time': 1774697783.876837, 'last_price_update_time': 1774697783.876847, 'auction_closing_time': 1774883231.0}
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN56944') HTTP/1.1" 204 0
2026-03-28 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_591d6f306e778ef5d0ff44c24b291c23.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_591d6f306e778ef5d0ff44c24b291c23.jpg not downloaded yet
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_abb43556bb44e0e15df8624ac2e253a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0ae2050>
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_c9a2c3794d366bdec2787640831bb971.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_c9a2c3794d366bdec2787640831bb971.jpg saved to cache
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35ba590>
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_623f6de5a47fdaaf205b8cac5e4c7562.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_623f6de5a47fdaaf205b8cac5e4c7562.jpg saved to cache
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04be410>
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_f0ec273fb25cb0a2ef8d0913e2343fb7.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_f0ec273fb25cb0a2ef8d0913e2343fb7.jpg saved to cache
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_1243eb07c51b7fdd454427d9e82088d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_b4fe12d012dc444cacdb12e85de2d350.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_4bc15666b46a755e0e782569d638d267.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_4bc15666b46a755e0e782569d638d267.jpg not downloaded yet
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_0435539797d0862795a6a9b55e889e4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_0435539797d0862795a6a9b55e889e4c.jpg not downloaded yet
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_f47bc862ac80f29680b55f3aace3cd80.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_d960a4b5b3006e10c398aaff976e14eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_27a5812788c387a64efdee9588517740.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_27a5812788c387a64efdee9588517740.jpg not downloaded yet
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd087cad0>
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_abb43556bb44e0e15df8624ac2e253a6.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_abb43556bb44e0e15df8624ac2e253a6.jpg saved to cache
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6af71bd9a8fb71706c5561c8a66cfd96.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_25d2198b68da7bc12258c9a9ffd7b4ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_d857e7e12742737a08747f7848ab87b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_52dfeff1a99fa84295be64ddc2c77c74.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_52dfeff1a99fa84295be64ddc2c77c74.jpg not downloaded yet
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_519cdd88fe0545a63416df655e3a4cb9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0978910>
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252Fce%252F95ced29b25e29d3d523304d4cad27f3d%252Fpa%252FVW85401_1243eb07c51b7fdd454427d9e82088d7.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_1243eb07c51b7fdd454427d9e82088d7.jpg saved to cache
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d926fef6-910b-5432-a36a-00184b952d18
2026-03-28 11:36:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d926fef6-910b-5432-a36a-00184b952d18, skipping ID generation
2026-03-28 11:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d926fef6-910b-5432-a36a-00184b952d18 with scrape type 1
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d926fef6-910b-5432-a36a-00184b952d18 sending to next pipeline
2026-03-28 11:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d926fef6-910b-5432-a36a-00184b952d18, identifier: VW85401
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35bb7d0>
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_b4fe12d012dc444cacdb12e85de2d350.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_b4fe12d012dc444cacdb12e85de2d350.jpg saved to cache
2026-03-28 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14
2026-03-28 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6f7bc50405b93d5956beb7adcdae8930.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d926fef6-910b-5432-a36a-00184b952d18 with identifier: VW85401
2026-03-28 11:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d926fef6-910b-5432-a36a-00184b952d18 with identifier: VW85401
2026-03-28 11:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d926fef6-910b-5432-a36a-00184b952d18 with identifier: VW85401 to the API
2026-03-28 11:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_1243eb07c51b7fdd454427d9e82088d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:30Z',
 'fuel_type': 'diesel',
 'id': 'd926fef6-910b-5432-a36a-00184b952d18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW85401',
 'listing': 'auction',
 'location': 'BE, Aarschot',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 80940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_0a7161f0f1d00e0582e119b4f3ee0ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2376732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_2c8cfa6d42df9988602bec98944845bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_1243eb07c51b7fdd454427d9e82088d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_abb43556bb44e0e15df8624ac2e253a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_c9a2c3794d366bdec2787640831bb971.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_15385e444f4932ad57fd0c0e2b0fca1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_becb9ae2fd46c9e83f07bd0ad902d05e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_31dc28a240bd565be7c4acd641779a25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2386376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_83b649a7ef56b740e0f77a2195f575bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d926fef6-910b-5432-a36a-00184b952d18/d926fef6-910b-5432-a36a-00184b952d18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img95/ce/95ced29b25e29d3d523304d4cad27f3d/pa/VW85401_59e9d5561653fc68894c93bb3f3f0dec.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Origin',
 'transmission': 'manual',
 'trim': 'Origin',
 'year': 2011}
2026-03-28 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW85401%27 HTTP/1.1" 200 None
2026-03-28 11:36:25 [auto1.be] INFO: Saving data for VW85401: {'created_time': 1774697785.802737, 'last_price_update_time': 1774697785.802746, 'auction_closing_time': 1774885350.0}
2026-03-28 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW85401') HTTP/1.1" 204 0
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9867d945604593ded262e263313ebc9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_efccbbb2e123af47627239c041b1ab01.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_591d6f306e778ef5d0ff44c24b291c23.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_6033dd6f4256b10e675bb485a74c1b24.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_4bc15666b46a755e0e782569d638d267.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_0435539797d0862795a6a9b55e889e4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV21741> (referer: https://www.auto1.com/v1/car-details-view/EV21741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a33d10>
2026-03-28 11:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_f47bc862ac80f29680b55f3aace3cd80.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_f47bc862ac80f29680b55f3aace3cd80.jpg saved to cache
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1470790>
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6c%252Fc66c96c46580e3fc6a146b61636430a9%252Fpa%252FDJ63605_d960a4b5b3006e10c398aaff976e14eb.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_d960a4b5b3006e10c398aaff976e14eb.jpg saved to cache
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40
2026-03-28 11:36:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40, skipping ID generation
2026-03-28 11:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with scrape type 1
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 sending to next pipeline
2026-03-28 11:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40, identifier: DJ63605
2026-03-28 11:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ef410>
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_6af71bd9a8fb71706c5561c8a66cfd96.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6af71bd9a8fb71706c5561c8a66cfd96.jpg saved to cache
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14c7010>
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_25d2198b68da7bc12258c9a9ffd7b4ff.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_25d2198b68da7bc12258c9a9ffd7b4ff.jpg saved to cache
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14c4d90>
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_d857e7e12742737a08747f7848ab87b9.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_d857e7e12742737a08747f7848ab87b9.jpg saved to cache
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35c1490>
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F0c%252Fe70ca9a341f8928a1c38babed6e7e590%252Fpa%252FHX50025_519cdd88fe0545a63416df655e3a4cb9.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_519cdd88fe0545a63416df655e3a4cb9.jpg saved to cache
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14
2026-03-28 11:36:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14, skipping ID generation
2026-03-28 11:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with scrape type 1
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 sending to next pipeline
2026-03-28 11:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14, identifier: HX50025
2026-03-28 11:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd153c2d0>
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F2a%252Fd92a4831fca0219f4af261d65efe83e7%252Fpa%252FPP72448_6f7bc50405b93d5956beb7adcdae8930.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6f7bc50405b93d5956beb7adcdae8930.jpg saved to cache
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c
2026-03-28 11:36:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c, skipping ID generation
2026-03-28 11:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with scrape type 1
2026-03-28 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c sending to next pipeline
2026-03-28 11:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c, identifier: PP72448
2026-03-28 11:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-28 11:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-28 11:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605 to the API
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_d960a4b5b3006e10c398aaff976e14eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:01Z',
 'fuel_type': 'petrol',
 'id': 'c91f71ac-999d-54f8-b90c-1b6fcb4c8f40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ63605',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 107256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_0e5dfd4d2c92922475d506ef7c366098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_48affcf090264e6d45f1cfc114240461.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2379846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_f47bc862ac80f29680b55f3aace3cd80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_d960a4b5b3006e10c398aaff976e14eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_027b3ccd521469375e8c3c5d50b22343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_3c8e3dcb514618530d1c647121a219ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292102,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_cba733af5b0690b2e70aad4028778106.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_e9d6aff97ede662af4c5c9f579bd700d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_a5a7aedf7b74d4dba569d315297b6596.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91f71ac-999d-54f8-b90c-1b6fcb4c8f40/c91f71ac-999d-54f8-b90c-1b6fcb4c8f40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2448647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/6c/c66c96c46580e3fc6a146b61636430a9/pa/DJ63605_b28f3cd645d8ef2ae2ec87a41987af1c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-28 11:36:27 [auto1.be] INFO: Saving data for DJ63605: {'created_time': 1774697787.104539, 'last_price_update_time': 1774697787.10455, 'auction_closing_time': 1774883281.0}
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ63605') HTTP/1.1" 204 0
2026-03-28 11:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-28 11:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-28 11:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025 to the API
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_519cdd88fe0545a63416df655e3a4cb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'diesel',
 'id': '2e6c0b59-8a39-5bbd-b079-1bea41edcf14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX50025',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 144487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_519cdd88fe0545a63416df655e3a4cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_25d2198b68da7bc12258c9a9ffd7b4ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_d857e7e12742737a08747f7848ab87b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_b4fe12d012dc444cacdb12e85de2d350.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_f0ec273fb25cb0a2ef8d0913e2343fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c0b59-8a39-5bbd-b079-1bea41edcf14/2e6c0b59-8a39-5bbd-b079-1bea41edcf14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/0c/e70ca9a341f8928a1c38babed6e7e590/pa/HX50025_623f6de5a47fdaaf205b8cac5e4c7562.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-28 11:36:27 [auto1.be] INFO: Saving data for HX50025: {'created_time': 1774697787.47083, 'last_price_update_time': 1774697787.470862, 'auction_closing_time': 1774883847.0}
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX50025') HTTP/1.1" 204 0
2026-03-28 11:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-28 11:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-28 11:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448 to the API
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6f7bc50405b93d5956beb7adcdae8930.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:20Z',
 'fuel_type': 'diesel',
 'id': 'a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP72448',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 79106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_f4d95310ee352caa19921614882067f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_a54311761b40769a37954ea27d0a6478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_0da97a29c2f54ca6a2ee4f62bf0b01ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4ed03924a6bbe7c2435f40109ef33da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_d62da29d5f18447bf1814a6ab4ba6ca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_81b4000da0aac053905045cc2da99816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_4c86f6294a7e6140d5bbaf00ad6690a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6af71bd9a8fb71706c5561c8a66cfd96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2488777,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_6f7bc50405b93d5956beb7adcdae8930.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c/a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/2a/d92a4831fca0219f4af261d65efe83e7/pa/PP72448_e590b3372b3fa01291942340393dc4b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium AWD',
 'transmission': 'automatic',
 'trim': 'Titanium AWD',
 'year': 2019}
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-28 11:36:27 [auto1.be] INFO: Saving data for PP72448: {'created_time': 1774697787.941228, 'last_price_update_time': 1774697787.94124, 'auction_closing_time': 1774884920.0}
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PP72448') HTTP/1.1" 204 0
2026-03-28 11:36:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a33090>
2026-03-28 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F41%252Fde414d095c11e606f23783850199a90a%252Fpa%252FUC18604_9867d945604593ded262e263313ebc9a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9867d945604593ded262e263313ebc9a.jpg saved to cache
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b173c489-7538-5260-a6f8-21e29901460c
2026-03-28 11:36:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b173c489-7538-5260-a6f8-21e29901460c, skipping ID generation
2026-03-28 11:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b173c489-7538-5260-a6f8-21e29901460c with scrape type 1
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b173c489-7538-5260-a6f8-21e29901460c sending to next pipeline
2026-03-28 11:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b173c489-7538-5260-a6f8-21e29901460c, identifier: UC18604
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09f3150>
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_efccbbb2e123af47627239c041b1ab01.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_efccbbb2e123af47627239c041b1ab01.jpg saved to cache
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ac090>
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_591d6f306e778ef5d0ff44c24b291c23.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_591d6f306e778ef5d0ff44c24b291c23.jpg saved to cache
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14293d0>
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_6033dd6f4256b10e675bb485a74c1b24.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_6033dd6f4256b10e675bb485a74c1b24.jpg saved to cache
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0371ffca-6417-5000-9cfe-c3e1707bd28b
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04da1d0>
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_4bc15666b46a755e0e782569d638d267.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_4bc15666b46a755e0e782569d638d267.jpg saved to cache
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04b8c90>
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_0435539797d0862795a6a9b55e889e4c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_0435539797d0862795a6a9b55e889e4c.jpg saved to cache
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60
2026-03-28 11:36:28 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1819 | hits on page: 40
2026-03-28 11:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-28 11:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with scrape type 1
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_4d46deaef3608b8153285c1949fb129c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_4d46deaef3608b8153285c1949fb129c.jpg not downloaded yet
2026-03-28 11:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-28 11:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-28 11:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604 to the API
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9867d945604593ded262e263313ebc9a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:11:24Z',
 'fuel_type': 'diesel',
 'id': 'b173c489-7538-5260-a6f8-21e29901460c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC18604',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 108276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_d098ba705cdbd4d431bf0eed2d0e8d2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9a87f7e69d6aeea6f059ccbd752bca88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_22dce8c6e7c7d77ca4c5f8316ea571d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2580977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_9867d945604593ded262e263313ebc9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_88486a13f6fcaae8c7a5d961921e2b2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_78eb0384e10c60c42dde6030a7b5d23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543691,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_0677b838d3676735368d3b90777c9225.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638873,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_cdc3a1205034906997a2cc539ddc3df1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_ee83804dd8f597fba16d7d9efdaf36d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b173c489-7538-5260-a6f8-21e29901460c/b173c489-7538-5260-a6f8-21e29901460c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/41/de414d095c11e606f23783850199a90a/pa/UC18604_530e6e84aa241a8d6b385ddd416ab7e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2H1 29 Kasten',
 'transmission': 'manual',
 'trim': 'L2H1 29 Kasten',
 'year': 2014}
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-28 11:36:28 [auto1.be] INFO: Saving data for UC18604: {'created_time': 1774697788.703516, 'last_price_update_time': 1774697788.703526, 'auction_closing_time': 1774883484.0}
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC18604') HTTP/1.1" 204 0
2026-03-28 11:36:28 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG55963%27 HTTP/1.1" 200 None
2026-03-28 11:36:28 [auto1.be] INFO: Scrape type for WG55963: 0
2026-03-28 11:36:28 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-28 11:36:28 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK47918%27 HTTP/1.1" 200 None
2026-03-28 11:36:28 [auto1.be] INFO: Scrape type for LK47918: 0
2026-03-28 11:36:28 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 11:36:28 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT24920%27 HTTP/1.1" 200 None
2026-03-28 11:36:28 [auto1.be] INFO: Scrape type for GT24920: 2
2026-03-28 11:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a261bfa-b626-5518-80de-cda66dd351a0 with identifier: GT24920
2026-03-28 11:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a261bfa-b626-5518-80de-cda66dd351a0 with scrape type 2
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a261bfa-b626-5518-80de-cda66dd351a0 with scrape type 2
2026-03-28 11:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a261bfa-b626-5518-80de-cda66dd351a0, identifier: GT24920
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_875f33259e553e529dab9389d7a4884c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_875f33259e553e529dab9389d7a4884c.jpg not downloaded yet
2026-03-28 11:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a261bfa-b626-5518-80de-cda66dd351a0 with identifier: GT24920
2026-03-28 11:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a261bfa-b626-5518-80de-cda66dd351a0 with identifier: GT24920
2026-03-28 11:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a261bfa-b626-5518-80de-cda66dd351a0 with identifier: GT24920 to the API
2026-03-28 11:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:17:18Z',
 'fuel_type': 'petrol',
 'id': '0a261bfa-b626-5518-80de-cda66dd351a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT24920',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 100799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT24920%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Saving data for GT24920: {'auction_closing_time': 1774714638.0, 'created_time': 1774514147.840912, 'last_price_update_time': 1774697789.757232}
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GT24920') HTTP/1.1" 204 0
2026-03-28 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG16412> (referer: https://www.auto1.com/v1/car-details-view/AG16412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK78813%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for CK78813: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL07479%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for FL07479: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV70453%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for KV70453: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT18330%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for BT18330: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF01400%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for JF01400: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL13165%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for VL13165: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for WN85390: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV74957%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for KV74957: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-28 11:36:29 [auto1.be] INFO: Scrape type for YB46987: 0
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-28 11:36:29 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-28 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ37534%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Scrape type for YJ37534: 0
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Scrape type for TY97185: 2
2026-03-28 11:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185
2026-03-28 11:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b6ae16-5df6-5699-9b9f-54becf3d2522 with scrape type 2
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51b6ae16-5df6-5699-9b9f-54becf3d2522 with scrape type 2
2026-03-28 11:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51b6ae16-5df6-5699-9b9f-54becf3d2522, identifier: TY97185
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_2890be7d502ef322646827b4d6075708.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_2890be7d502ef322646827b4d6075708.jpg not downloaded yet
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ95673> (referer: https://www.auto1.com/v1/car-details-view/BZ95673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185
2026-03-28 11:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51b6ae16-5df6-5699-9b9f-54becf3d2522 with identifier: TY97185 to the API
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:41:37Z',
 'fuel_type': 'petrol',
 'id': '51b6ae16-5df6-5699-9b9f-54becf3d2522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY97185',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 95663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-03',
 'seller_name': None,
 'title': 'Dacia Dokker 1.3 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2020}
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Saving data for TY97185: {'auction_closing_time': 1774716097.0, 'created_time': 1774514151.498494, 'last_price_update_time': 1774697790.525154}
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY97185') HTTP/1.1" 204 0
2026-03-28 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG04214%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Scrape type for CG04214: 0
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH51844%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Scrape type for BH51844: 0
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ18869%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [auto1.be] INFO: Scrape type for DZ18869: 0
2026-03-28 11:36:30 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_ea9d9752ddb5ec07fc3c01416d1ba24d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_ea9d9752ddb5ec07fc3c01416d1ba24d.jpg not downloaded yet
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_27a5812788c387a64efdee9588517740.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_34d7f6408bc87bd92c7de222888033de.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_79233f09460d1397965f58e1b9039552.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_4d46deaef3608b8153285c1949fb129c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_52dfeff1a99fa84295be64ddc2c77c74.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_fbbf9e77cfd2257520fda045844c3b42.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-28 11:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b with scrape type 1
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_4477fa6e24d7d74b79962ae57e199a55.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_4477fa6e24d7d74b79962ae57e199a55.jpg not downloaded yet
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_83b9f2f748b063bd19eb3babf2ab24da.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_83b9f2f748b063bd19eb3babf2ab24da.jpg not downloaded yet
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_89038caf1f4db7d46a90bad42f6668ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_89038caf1f4db7d46a90bad42f6668ea.jpg not downloaded yet
2026-03-28 11:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-28 11:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010df3b2-67e1-515a-9167-f86a53c05da9 with scrape type 1
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_8fc4957b9cf0fa563edf430f88adea10.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8fc4957b9cf0fa563edf430f88adea10.jpg not downloaded yet
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_a45c5eb4207e236a6003d0978a4b4216.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_a45c5eb4207e236a6003d0978a4b4216.jpg not downloaded yet
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_acbe7f332dbe04115774faaf3d88d66c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_acbe7f332dbe04115774faaf3d88d66c.jpg not downloaded yet
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_8b1b18f5faba4ebd837718ed51fead04.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8b1b18f5faba4ebd837718ed51fead04.jpg not downloaded yet
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_175fc3fe2bcdaeba08579feaae5b6f67.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_967cce54d542c74b8844b1b181ae7864.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_875f33259e553e529dab9389d7a4884c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_2890be7d502ef322646827b4d6075708.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_c319bf24f3584c031b040b8b64d596e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c319bf24f3584c031b040b8b64d596e7.jpg not downloaded yet
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_6e9d3963555d2b19264d583f2dde7185.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_6e9d3963555d2b19264d583f2dde7185.jpg not downloaded yet
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a07e10>
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_27a5812788c387a64efdee9588517740.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_27a5812788c387a64efdee9588517740.jpg saved to cache
2026-03-28 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd049a1d0>
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_34d7f6408bc87bd92c7de222888033de.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_34d7f6408bc87bd92c7de222888033de.jpg saved to cache
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08e1bd0>
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F57%252Fb357fb8db0d864e62fb997185e11deec%252Fpa%252FUY92003_79233f09460d1397965f58e1b9039552.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_79233f09460d1397965f58e1b9039552.jpg saved to cache
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0371ffca-6417-5000-9cfe-c3e1707bd28b
2026-03-28 11:36:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0371ffca-6417-5000-9cfe-c3e1707bd28b, skipping ID generation
2026-03-28 11:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0371ffca-6417-5000-9cfe-c3e1707bd28b with scrape type 1
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0371ffca-6417-5000-9cfe-c3e1707bd28b sending to next pipeline
2026-03-28 11:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0371ffca-6417-5000-9cfe-c3e1707bd28b, identifier: UY92003
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04e7790>
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_4d46deaef3608b8153285c1949fb129c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_4d46deaef3608b8153285c1949fb129c.jpg saved to cache
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09173d0>
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F11%252F3f1114c0e760ec9241b8dc74ff90b03e%252Fpa%252FTC61218_52dfeff1a99fa84295be64ddc2c77c74.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_52dfeff1a99fa84295be64ddc2c77c74.jpg saved to cache
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60
2026-03-28 11:36:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c70514e2-cfa6-53b4-966f-1ba51a7b9e60, skipping ID generation
2026-03-28 11:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with scrape type 1
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60 sending to next pipeline
2026-03-28 11:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c70514e2-cfa6-53b4-966f-1ba51a7b9e60, identifier: TC61218
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b61a90>
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_fbbf9e77cfd2257520fda045844c3b42.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_fbbf9e77cfd2257520fda045844c3b42.jpg saved to cache
2026-03-28 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb386063-39c7-587d-ad9a-ff6800bae828
2026-03-28 11:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-28 11:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-28 11:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003 to the API
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_79233f09460d1397965f58e1b9039552.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:32Z',
 'fuel_type': 'petrol',
 'id': '0371ffca-6417-5000-9cfe-c3e1707bd28b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY92003',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Toyota',
 'model': 'Yaris Verso',
 'odometer': 106735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_79233f09460d1397965f58e1b9039552.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_6033dd6f4256b10e675bb485a74c1b24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_9f677a6ceee06dc0c6beb6bb35da0cb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2007a27acf9cb22e5a99f469b166b3dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_d87ff2f3979a44a879c048d0820f748f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0371ffca-6417-5000-9cfe-c3e1707bd28b/0371ffca-6417-5000-9cfe-c3e1707bd28b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/57/b357fb8db0d864e62fb997185e11deec/pa/UY92003_2ad2b736b534efa543f5c7f33eff0f88.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Verso 1.3 VVT-i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-28 11:36:31 [auto1.be] INFO: Saving data for UY92003: {'created_time': 1774697791.974794, 'last_price_update_time': 1774697791.974804, 'auction_closing_time': 1774886312.0}
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY92003') HTTP/1.1" 204 0
2026-03-28 11:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-28 11:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-28 11:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218 to the API
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_52dfeff1a99fa84295be64ddc2c77c74.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:29Z',
 'fuel_type': 'petrol',
 'id': 'c70514e2-cfa6-53b4-966f-1ba51a7b9e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC61218',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 78437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_efccbbb2e123af47627239c041b1ab01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_591d6f306e778ef5d0ff44c24b291c23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_4bc15666b46a755e0e782569d638d267.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_0435539797d0862795a6a9b55e889e4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_27a5812788c387a64efdee9588517740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c70514e2-cfa6-53b4-966f-1ba51a7b9e60/c70514e2-cfa6-53b4-966f-1ba51a7b9e60_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/11/3f1114c0e760ec9241b8dc74ff90b03e/pa/TC61218_52dfeff1a99fa84295be64ddc2c77c74.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-04-29',
 'seats_number': 4,
 'seller_name': None,
 'title': "Opel Tigra 1.4 Color Line 'Chequers'",
 'transmission': 'manual',
 'trim': "Color Line 'Chequers'",
 'year': 1999}
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-28 11:36:32 [auto1.be] INFO: Saving data for TC61218: {'created_time': 1774697792.341597, 'last_price_update_time': 1774697792.341607, 'auction_closing_time': 1774884269.0}
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC61218') HTTP/1.1" 204 0
2026-03-28 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_ea9d9752ddb5ec07fc3c01416d1ba24d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_f92337f7ba4870357aa357c982363896.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_f92337f7ba4870357aa357c982363896.jpg not downloaded yet
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_4aebe10af20d5d72d480d65c02272eff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_4aebe10af20d5d72d480d65c02272eff.jpg not downloaded yet
2026-03-28 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_31da943c441b33fd81b93a84eaf39fc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a56e90>
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F66%252Fa8666c56347bcebf1f3cef14d3e70455%252Fpa%252FNV64774_175fc3fe2bcdaeba08579feaae5b6f67.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_175fc3fe2bcdaeba08579feaae5b6f67.jpg saved to cache
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb386063-39c7-587d-ad9a-ff6800bae828
2026-03-28 11:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb386063-39c7-587d-ad9a-ff6800bae828, skipping ID generation
2026-03-28 11:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb386063-39c7-587d-ad9a-ff6800bae828 with scrape type 1
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb386063-39c7-587d-ad9a-ff6800bae828 sending to next pipeline
2026-03-28 11:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb386063-39c7-587d-ad9a-ff6800bae828, identifier: NV64774
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0524310>
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_967cce54d542c74b8844b1b181ae7864.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_967cce54d542c74b8844b1b181ae7864.jpg saved to cache
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29a35d51-4951-5c9f-8818-3370273c76ff
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a60d50>
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_875f33259e553e529dab9389d7a4884c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_875f33259e553e529dab9389d7a4884c.jpg saved to cache
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a1b310>
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_2890be7d502ef322646827b4d6075708.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_2890be7d502ef322646827b4d6075708.jpg saved to cache
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_3bafa35102187c5d4eae1de0dcbd8d24.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_3bafa35102187c5d4eae1de0dcbd8d24.jpg not downloaded yet
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_abeccc87e5310d726a204fd750f66d48.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_abeccc87e5310d726a204fd750f66d48.jpg not downloaded yet
2026-03-28 11:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-28 11:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-28 11:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774 to the API
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_175fc3fe2bcdaeba08579feaae5b6f67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:35:10Z',
 'fuel_type': 'petrol',
 'id': 'cb386063-39c7-587d-ad9a-ff6800bae828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV64774',
 'listing': 'auction',
 'location': 'BE, Lommel',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 236390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_175fc3fe2bcdaeba08579feaae5b6f67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_fbbf9e77cfd2257520fda045844c3b42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_dba206d0ca8b53009f2635cb7f6d67ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_3fa09d75810dbc77da427d6dc0ad971c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb386063-39c7-587d-ad9a-ff6800bae828/cb386063-39c7-587d-ad9a-ff6800bae828_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/66/a8666c56347bcebf1f3cef14d3e70455/pa/NV64774_b3e579110965d8e1cabeeabb31463f8a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [auto1.be] INFO: Saving data for NV64774: {'created_time': 1774697793.043121, 'last_price_update_time': 1774697793.04313, 'auction_closing_time': 1774884910.0}
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV64774') HTTP/1.1" 204 0
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_a45c5eb4207e236a6003d0978a4b4216.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8fc4957b9cf0fa563edf430f88adea10.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8b1b18f5faba4ebd837718ed51fead04.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_c5a687fb175813eb36fdabb57b5c9405.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c5a687fb175813eb36fdabb57b5c9405.jpg not downloaded yet
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_5a918beb7fb24cdfce8c06a7c869403d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5a918beb7fb24cdfce8c06a7c869403d.jpg not downloaded yet
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH00217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG72967/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_6e9d3963555d2b19264d583f2dde7185.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08c3d90>
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_ea9d9752ddb5ec07fc3c01416d1ba24d.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_ea9d9752ddb5ec07fc3c01416d1ba24d.jpg saved to cache
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08c6650>
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F40%252F914065a705005e1211e2ea647d240a4f%252Fpa%252FZP95092_31da943c441b33fd81b93a84eaf39fc7.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_31da943c441b33fd81b93a84eaf39fc7.jpg saved to cache
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29a35d51-4951-5c9f-8818-3370273c76ff
2026-03-28 11:36:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29a35d51-4951-5c9f-8818-3370273c76ff, skipping ID generation
2026-03-28 11:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a35d51-4951-5c9f-8818-3370273c76ff with scrape type 1
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29a35d51-4951-5c9f-8818-3370273c76ff sending to next pipeline
2026-03-28 11:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29a35d51-4951-5c9f-8818-3370273c76ff, identifier: ZP95092
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_860614b9f2c52dfdaf557a0f91fee2bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_860614b9f2c52dfdaf557a0f91fee2bd.jpg not downloaded yet
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_5e00d0900de3754950445f6704f804e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5e00d0900de3754950445f6704f804e7.jpg not downloaded yet
2026-03-28 11:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-28 11:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-28 11:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092 to the API
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_31da943c441b33fd81b93a84eaf39fc7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:16:36Z',
 'fuel_type': 'diesel',
 'id': '29a35d51-4951-5c9f-8818-3370273c76ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP95092',
 'listing': 'auction',
 'location': 'BE, Wommelgem',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 155775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_967cce54d542c74b8844b1b181ae7864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_59c76d2ec71117d032d4c43ce384ee22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_31da943c441b33fd81b93a84eaf39fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_24de344077f7524fb15b8a168c6edbc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_42a14d2648f9ab68fb281508c199909f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a35d51-4951-5c9f-8818-3370273c76ff/29a35d51-4951-5c9f-8818-3370273c76ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/40/914065a705005e1211e2ea647d240a4f/pa/ZP95092_f5583bc4a4e17af26a63f732ebd02150.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [auto1.be] INFO: Saving data for ZP95092: {'created_time': 1774697793.64774, 'last_price_update_time': 1774697793.64775, 'auction_closing_time': 1774883796.0}
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP95092') HTTP/1.1" 204 0
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV95387> (referer: https://www.auto1.com/v1/car-details-view/ZV95387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ39097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_4aebe10af20d5d72d480d65c02272eff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_1a10dfc44e460e59c11b5077eef30a7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_1a10dfc44e460e59c11b5077eef30a7c.jpg not downloaded yet
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_c50356f908fc68adffb5e8f1ba196e53.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_c50356f908fc68adffb5e8f1ba196e53.jpg not downloaded yet
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_3bafa35102187c5d4eae1de0dcbd8d24.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_abeccc87e5310d726a204fd750f66d48.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC10935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW23905> (referer: https://www.auto1.com/v1/car-details-view/VW23905/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_cbdb0ec0d501bf36b0d38b23980fb72b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_80b44bcfeda0fc939066a3839c044425.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_80b44bcfeda0fc939066a3839c044425.jpg not downloaded yet
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_bbde58250b209bbe8aab910dcb545a96.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_bbde58250b209bbe8aab910dcb545a96.jpg not downloaded yet
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b36d10>
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_a45c5eb4207e236a6003d0978a4b4216.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_a45c5eb4207e236a6003d0978a4b4216.jpg saved to cache
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd090dc90>
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_8fc4957b9cf0fa563edf430f88adea10.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8fc4957b9cf0fa563edf430f88adea10.jpg saved to cache
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0896f10>
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_8b1b18f5faba4ebd837718ed51fead04.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8b1b18f5faba4ebd837718ed51fead04.jpg saved to cache
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13eb150>
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_6e9d3963555d2b19264d583f2dde7185.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_6e9d3963555d2b19264d583f2dde7185.jpg saved to cache
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_ba1af0888ca2d752f2f64db64c83f68a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_ba1af0888ca2d752f2f64db64c83f68a.jpg not downloaded yet
2026-03-28 11:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_f92337f7ba4870357aa357c982363896.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5e00d0900de3754950445f6704f804e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-28 11:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0881ec-6709-5d81-81b2-5054e324342b with scrape type 1
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_1e1f32d71ffc00d98c03c12d6391651a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_1e1f32d71ffc00d98c03c12d6391651a.jpg not downloaded yet
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14598d0>
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_4aebe10af20d5d72d480d65c02272eff.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_4aebe10af20d5d72d480d65c02272eff.jpg saved to cache
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08fd350>
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_3bafa35102187c5d4eae1de0dcbd8d24.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_3bafa35102187c5d4eae1de0dcbd8d24.jpg saved to cache
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd14e8190>
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_abeccc87e5310d726a204fd750f66d48.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_abeccc87e5310d726a204fd750f66d48.jpg saved to cache
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-28 11:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f76f7f9d-b84f-598c-952c-b8892a754a78 with scrape type 1
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f76f7f9d-b84f-598c-952c-b8892a754a78
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_8be4696cc74cd58334a99b7861cae82c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_8be4696cc74cd58334a99b7861cae82c.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_fad992e3e204d0e8408a87ead02439f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_fad992e3e204d0e8408a87ead02439f8.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_b63f23ad5273745de39c5005643d55fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_b63f23ad5273745de39c5005643d55fd.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_04f908a1187da4dbe5ebcbbfd346e1c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_04f908a1187da4dbe5ebcbbfd346e1c5.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_0832f0e85c4e7314f3ee420e2e819f0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_0832f0e85c4e7314f3ee420e2e819f0f.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_5cac7a4fc310d0e7c3b1df2cf290b70f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_5cac7a4fc310d0e7c3b1df2cf290b70f.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_03c5dc3cc4a4a616927f3946d25adaa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_03c5dc3cc4a4a616927f3946d25adaa8.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_85939f3475935ff0924b9bd3928c855a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_85939f3475935ff0924b9bd3928c855a.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_f6b4012db4adf6646faac1167fdeef8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_f6b4012db4adf6646faac1167fdeef8d.jpg already downloaded
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe2%252F98e281f80cf125d5f5cc068c35a0cde4%252Fpa%252FVW23905_1651824fa4385e586cd467190a473eb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_1651824fa4385e586cd467190a473eb0.jpg already downloaded
2026-03-28 11:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f76f7f9d-b84f-598c-952c-b8892a754a78, identifier: VW23905
2026-03-28 11:36:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0abbc10>
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F9c%252F9e9c4d6145b26bc508936fcdf0685d9e%252Fpa%252FKE51169_cbdb0ec0d501bf36b0d38b23980fb72b.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_cbdb0ec0d501bf36b0d38b23980fb72b.jpg saved to cache
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6952caac-088e-5006-9a46-9b48f1abe497
2026-03-28 11:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6952caac-088e-5006-9a46-9b48f1abe497, skipping ID generation
2026-03-28 11:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6952caac-088e-5006-9a46-9b48f1abe497 with scrape type 1
2026-03-28 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6952caac-088e-5006-9a46-9b48f1abe497 sending to next pipeline
2026-03-28 11:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6952caac-088e-5006-9a46-9b48f1abe497, identifier: KE51169
2026-03-28 11:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-28 11:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-28 11:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905 to the API
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW23905>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:51:57Z',
 'fuel_type': 'diesel',
 'id': 'f76f7f9d-b84f-598c-952c-b8892a754a78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW23905',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 88076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_8be4696cc74cd58334a99b7861cae82c.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_fad992e3e204d0e8408a87ead02439f8.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_b63f23ad5273745de39c5005643d55fd.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_04f908a1187da4dbe5ebcbbfd346e1c5.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_0832f0e85c4e7314f3ee420e2e819f0f.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_5cac7a4fc310d0e7c3b1df2cf290b70f.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_03c5dc3cc4a4a616927f3946d25adaa8.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_85939f3475935ff0924b9bd3928c855a.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_f6b4012db4adf6646faac1167fdeef8d.jpg',
                'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_1651824fa4385e586cd467190a473eb0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_8be4696cc74cd58334a99b7861cae82c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_fad992e3e204d0e8408a87ead02439f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_b63f23ad5273745de39c5005643d55fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_04f908a1187da4dbe5ebcbbfd346e1c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_0832f0e85c4e7314f3ee420e2e819f0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_5cac7a4fc310d0e7c3b1df2cf290b70f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_03c5dc3cc4a4a616927f3946d25adaa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_85939f3475935ff0924b9bd3928c855a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_f6b4012db4adf6646faac1167fdeef8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f76f7f9d-b84f-598c-952c-b8892a754a78/f76f7f9d-b84f-598c-952c-b8892a754a78_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e2/98e281f80cf125d5f5cc068c35a0cde4/pa/VW23905_1651824fa4385e586cd467190a473eb0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-28 11:36:34 [auto1.be] INFO: Saving data for VW23905: {'created_time': 1774697794.950548, 'last_price_update_time': 1774697794.950557, 'auction_closing_time': 1774885917.0}
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW23905') HTTP/1.1" 204 0
2026-03-28 11:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-28 11:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-28 11:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169 to the API
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_cbdb0ec0d501bf36b0d38b23980fb72b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:07Z',
 'fuel_type': 'diesel',
 'id': '6952caac-088e-5006-9a46-9b48f1abe497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE51169',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 130823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_cbdb0ec0d501bf36b0d38b23980fb72b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2122171,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_aebdb07cad503a2ff0528fb6fc5f507e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2166745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_5ad524ce52e7d87ff38fdf063b71c825.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2115667,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_fe1de5786723d4dc6f8353b2798bf4aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2146414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_30329198c45613fd3b32f9b422c9830f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a627ed0d82bc3792873aa4bcd4d1b727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2106813,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_97dac85e62b4a3fc772e0aa49e56a047.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_4acbe8fca7837e6428777b829abe1ee3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_a8f1c35a913c2967d9979a953b0cdc4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6952caac-088e-5006-9a46-9b48f1abe497/6952caac-088e-5006-9a46-9b48f1abe497_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/9c/9e9c4d6145b26bc508936fcdf0685d9e/pa/KE51169_8786f3eaf6779ecebf6f62b6d14eeac0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2010}
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-28 11:36:35 [auto1.be] INFO: Saving data for KE51169: {'created_time': 1774697795.32819, 'last_price_update_time': 1774697795.328202, 'auction_closing_time': 1774885447.0}
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE51169') HTTP/1.1" 204 0
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_3b50b34fa510fc15b81c6e89cd3cba14.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b50b34fa510fc15b81c6e89cd3cba14.jpg not downloaded yet
2026-03-28 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_83b9f2f748b063bd19eb3babf2ab24da.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_89038caf1f4db7d46a90bad42f6668ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b69c10>
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_f92337f7ba4870357aa357c982363896.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_f92337f7ba4870357aa357c982363896.jpg saved to cache
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09e0210>
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_5e00d0900de3754950445f6704f804e7.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5e00d0900de3754950445f6704f804e7.jpg saved to cache
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5a918beb7fb24cdfce8c06a7c869403d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_860614b9f2c52dfdaf557a0f91fee2bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_e1815d0d9c768e1ffa43182d1c0486ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_e1815d0d9c768e1ffa43182d1c0486ec.jpg not downloaded yet
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_0239c8063bc2016b14c376ad0be785b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_0239c8063bc2016b14c376ad0be785b3.jpg not downloaded yet
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_a43793685309e67a49aadd29f33ef910.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_a43793685309e67a49aadd29f33ef910.jpg not downloaded yet
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04cae50>
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F90%252F5a90e67e39aa1c4cb731a42f3fa61e14%252Fpa%252FEV21741_83b9f2f748b063bd19eb3babf2ab24da.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_83b9f2f748b063bd19eb3babf2ab24da.jpg saved to cache
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4
2026-03-28 11:36:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4, skipping ID generation
2026-03-28 11:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with scrape type 1
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 sending to next pipeline
2026-03-28 11:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4, identifier: EV21741
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a1b650>
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_89038caf1f4db7d46a90bad42f6668ea.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_89038caf1f4db7d46a90bad42f6668ea.jpg saved to cache
2026-03-28 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb5de49dab6507c63417b92ad0edaefb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-28 11:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-28 11:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741 to the API
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_83b9f2f748b063bd19eb3babf2ab24da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': 'b990d3ba-1fec-55d2-b815-9ecfdbfdbee4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV21741',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 181063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_4d46deaef3608b8153285c1949fb129c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_875f33259e553e529dab9389d7a4884c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_2890be7d502ef322646827b4d6075708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_ea9d9752ddb5ec07fc3c01416d1ba24d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_83b9f2f748b063bd19eb3babf2ab24da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b990d3ba-1fec-55d2-b815-9ecfdbfdbee4/b990d3ba-1fec-55d2-b815-9ecfdbfdbee4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/90/5a90e67e39aa1c4cb731a42f3fa61e14/pa/EV21741_a45c5eb4207e236a6003d0978a4b4216.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-28 11:36:36 [auto1.be] INFO: Saving data for EV21741: {'created_time': 1774697796.088869, 'last_price_update_time': 1774697796.088881, 'auction_closing_time': 1774883596.0}
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV21741') HTTP/1.1" 204 0
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_c50356f908fc68adffb5e8f1ba196e53.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_f8a8b8ace19f33d136dbf27cd681b6b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_f8a8b8ace19f33d136dbf27cd681b6b9.jpg not downloaded yet
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_ba1af0888ca2d752f2f64db64c83f68a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_1a10dfc44e460e59c11b5077eef30a7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_36f2f70b58a44082107989be2a881391.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_36f2f70b58a44082107989be2a881391.jpg not downloaded yet
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09f9350>
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_5a918beb7fb24cdfce8c06a7c869403d.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5a918beb7fb24cdfce8c06a7c869403d.jpg saved to cache
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09d9650>
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_860614b9f2c52dfdaf557a0f91fee2bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_860614b9f2c52dfdaf557a0f91fee2bd.jpg saved to cache
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04ea710>
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F4f%252Fc84fcbc61ce33021e4c07536797feb30%252Fpa%252FJB88665_fb5de49dab6507c63417b92ad0edaefb.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb5de49dab6507c63417b92ad0edaefb.jpg saved to cache
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9
2026-03-28 11:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9, skipping ID generation
2026-03-28 11:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9 with scrape type 1
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9 sending to next pipeline
2026-03-28 11:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9, identifier: JB88665
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_bbde58250b209bbe8aab910dcb545a96.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_af7dc7063821b64125a15751646650d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_af7dc7063821b64125a15751646650d0.jpg not downloaded yet
2026-03-28 11:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9 with identifier: JB88665
2026-03-28 11:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9 with identifier: JB88665
2026-03-28 11:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9 with identifier: JB88665 to the API
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb5de49dab6507c63417b92ad0edaefb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:32:14Z',
 'fuel_type': 'diesel',
 'id': '3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB88665',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 64182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_34d7f6408bc87bd92c7de222888033de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2167728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb5de49dab6507c63417b92ad0edaefb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_fb3b993c1b67636517dbd7d4d68d9e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_f99c0deb3cd4ff8a07fa4185ceb139c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2145873,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0f064323329c432101445758f53f3a71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_e45d7a78dc15cc8cbd95b7e2bba299d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0ba3bfcd8b6754c2ef4879ae34d33692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_0a82427b71b9adae5ad4e1eb2d5e68ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_b892bd7e7993c8e6053afebcfad29720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9/3406ed68-d5a3-5d54-8fcf-7d7d58f73ec9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/4f/c84fcbc61ce33021e4c07536797feb30/pa/JB88665_a964b9977f74a84e966870d073377e51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB88665%27 HTTP/1.1" 200 None
2026-03-28 11:36:36 [auto1.be] INFO: Saving data for JB88665: {'created_time': 1774697796.796814, 'last_price_update_time': 1774697796.796827, 'auction_closing_time': 1774884734.0}
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB88665') HTTP/1.1" 204 0
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_a43793685309e67a49aadd29f33ef910.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b50b34fa510fc15b81c6e89cd3cba14.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_1e1f32d71ffc00d98c03c12d6391651a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_19d6a12021b28d1990f408cfa44d2af7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_19d6a12021b28d1990f408cfa44d2af7.jpg not downloaded yet
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG72967> (referer: https://www.auto1.com/v1/car-details-view/ZG72967/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd097f150>
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_c50356f908fc68adffb5e8f1ba196e53.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_c50356f908fc68adffb5e8f1ba196e53.jpg saved to cache
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04cb0d0>
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_ba1af0888ca2d752f2f64db64c83f68a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_ba1af0888ca2d752f2f64db64c83f68a.jpg saved to cache
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04bbd90>
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_1a10dfc44e460e59c11b5077eef30a7c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_1a10dfc44e460e59c11b5077eef30a7c.jpg saved to cache
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH00217> (referer: https://www.auto1.com/v1/car-details-view/UH00217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_3b1c560d4cf30c9f8474fe9a08bf4206.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b1c560d4cf30c9f8474fe9a08bf4206.jpg not downloaded yet
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd1563310>
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fc0%252Fbfc02720726fe7e3a9e30e46d0026b6b%252Fpa%252FBZ95673_bbde58250b209bbe8aab910dcb545a96.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_bbde58250b209bbe8aab910dcb545a96.jpg saved to cache
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 010df3b2-67e1-515a-9167-f86a53c05da9
2026-03-28 11:36:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 010df3b2-67e1-515a-9167-f86a53c05da9, skipping ID generation
2026-03-28 11:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010df3b2-67e1-515a-9167-f86a53c05da9 with scrape type 1
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 010df3b2-67e1-515a-9167-f86a53c05da9 sending to next pipeline
2026-03-28 11:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 010df3b2-67e1-515a-9167-f86a53c05da9, identifier: BZ95673
2026-03-28 11:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-28 11:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-28 11:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673 to the API
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_bbde58250b209bbe8aab910dcb545a96.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:47Z',
 'fuel_type': 'diesel',
 'id': '010df3b2-67e1-515a-9167-f86a53c05da9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ95673',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 168075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8fc4957b9cf0fa563edf430f88adea10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_8b1b18f5faba4ebd837718ed51fead04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_6e9d3963555d2b19264d583f2dde7185.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_4aebe10af20d5d72d480d65c02272eff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_abeccc87e5310d726a204fd750f66d48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5a918beb7fb24cdfce8c06a7c869403d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_5e00d0900de3754950445f6704f804e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_c50356f908fc68adffb5e8f1ba196e53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_bbde58250b209bbe8aab910dcb545a96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_010df3b2-67e1-515a-9167-f86a53c05da9/010df3b2-67e1-515a-9167-f86a53c05da9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/c0/bfc02720726fe7e3a9e30e46d0026b6b/pa/BZ95673_ba1af0888ca2d752f2f64db64c83f68a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [auto1.be] INFO: Saving data for BZ95673: {'created_time': 1774697797.474401, 'last_price_update_time': 1774697797.474414, 'auction_closing_time': 1774885667.0}
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ95673') HTTP/1.1" 204 0
2026-03-28 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_36f2f70b58a44082107989be2a881391.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_e1815d0d9c768e1ffa43182d1c0486ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13f6cd0>
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_a43793685309e67a49aadd29f33ef910.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_a43793685309e67a49aadd29f33ef910.jpg saved to cache
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b54e90>
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_3b50b34fa510fc15b81c6e89cd3cba14.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b50b34fa510fc15b81c6e89cd3cba14.jpg saved to cache
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08fd350>
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_1e1f32d71ffc00d98c03c12d6391651a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_1e1f32d71ffc00d98c03c12d6391651a.jpg saved to cache
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-28 11:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6255b3bf-184a-5247-9765-2476d5bb33fc with scrape type 1
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6255b3bf-184a-5247-9765-2476d5bb33fc
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_f5537b07dfbace38d7b8f34216fcfe5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_f5537b07dfbace38d7b8f34216fcfe5f.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_210c76f015f431c5e2d336ba2000fe73.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_210c76f015f431c5e2d336ba2000fe73.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_cbd8dcf26e6d427113bf1118557aff0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_cbd8dcf26e6d427113bf1118557aff0a.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_d2186e45effc185e65b0d43e08f3f3c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_d2186e45effc185e65b0d43e08f3f3c2.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_d67c28a1cc4c36817c8f1350701a0744.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_d67c28a1cc4c36817c8f1350701a0744.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_9532141ad1b22be3e47c7823c745be9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_9532141ad1b22be3e47c7823c745be9d.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_9921a0d67c0fc64730ae8441ec30b340.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_9921a0d67c0fc64730ae8441ec30b340.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_c2e3355eca16cf69c91e0ec4e8d33702.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_c2e3355eca16cf69c91e0ec4e8d33702.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_7ce3334b704311cb441effabd9cfcba1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_7ce3334b704311cb441effabd9cfcba1.jpg already downloaded
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef068d1e0a18b04718278cabc2284dd3%252Fpa%252FZG72967_659651643735f826aa247301b7790463.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_659651643735f826aa247301b7790463.jpg already downloaded
2026-03-28 11:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6255b3bf-184a-5247-9765-2476d5bb33fc, identifier: ZG72967
2026-03-28 11:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-28 11:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad0aba6a-691f-5c26-962e-c15486b0fbab with scrape type 1
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ad0aba6a-691f-5c26-962e-c15486b0fbab
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_446e9b60086efcc404832db13e2c7fb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_446e9b60086efcc404832db13e2c7fb3.jpg not downloaded yet
2026-03-28 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_80b44bcfeda0fc939066a3839c044425.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-28 11:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-28 11:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967 to the API
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG72967>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:05:07Z',
 'fuel_type': 'petrol',
 'id': '6255b3bf-184a-5247-9765-2476d5bb33fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG72967',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 69929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_f5537b07dfbace38d7b8f34216fcfe5f.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_210c76f015f431c5e2d336ba2000fe73.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_cbd8dcf26e6d427113bf1118557aff0a.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_d2186e45effc185e65b0d43e08f3f3c2.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_d67c28a1cc4c36817c8f1350701a0744.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_9532141ad1b22be3e47c7823c745be9d.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_9921a0d67c0fc64730ae8441ec30b340.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_c2e3355eca16cf69c91e0ec4e8d33702.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_7ce3334b704311cb441effabd9cfcba1.jpg',
                'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_659651643735f826aa247301b7790463.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_f5537b07dfbace38d7b8f34216fcfe5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573263,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_210c76f015f431c5e2d336ba2000fe73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_cbd8dcf26e6d427113bf1118557aff0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_d2186e45effc185e65b0d43e08f3f3c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_d67c28a1cc4c36817c8f1350701a0744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_9532141ad1b22be3e47c7823c745be9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_9921a0d67c0fc64730ae8441ec30b340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1937823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_c2e3355eca16cf69c91e0ec4e8d33702.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_7ce3334b704311cb441effabd9cfcba1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6255b3bf-184a-5247-9765-2476d5bb33fc/6255b3bf-184a-5247-9765-2476d5bb33fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2041475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef068d1e0a18b04718278cabc2284dd3/pa/ZG72967_659651643735f826aa247301b7790463.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Fiorino 1.4 SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2010}
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [auto1.be] INFO: Saving data for ZG72967: {'created_time': 1774697798.380371, 'last_price_update_time': 1774697798.380381, 'auction_closing_time': 1774883107.0}
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG72967') HTTP/1.1" 204 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_f71f25e26a5596dde644eca3f74487ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_f71f25e26a5596dde644eca3f74487ff.jpg not downloaded yet
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_f8a8b8ace19f33d136dbf27cd681b6b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_af7dc7063821b64125a15751646650d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC10935> (referer: https://www.auto1.com/v1/car-details-view/SC10935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_654912baeb923d31379db490e8fc080a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_654912baeb923d31379db490e8fc080a.jpg not downloaded yet
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ39097> (referer: https://www.auto1.com/v1/car-details-view/ZZ39097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04b7d90>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_36f2f70b58a44082107989be2a881391.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_36f2f70b58a44082107989be2a881391.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09eb110>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_e1815d0d9c768e1ffa43182d1c0486ec.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_e1815d0d9c768e1ffa43182d1c0486ec.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04bb190>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_80b44bcfeda0fc939066a3839c044425.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_80b44bcfeda0fc939066a3839c044425.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_13b1d10dbb17ef0350d92ef76c7ebab9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_13b1d10dbb17ef0350d92ef76c7ebab9.jpg not downloaded yet
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_19d6a12021b28d1990f408cfa44d2af7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b1c560d4cf30c9f8474fe9a08bf4206.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_446e9b60086efcc404832db13e2c7fb3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_3a9c61232d45c9375348e1809656e6af.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_3a9c61232d45c9375348e1809656e6af.jpg not downloaded yet
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09ebc90>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_f8a8b8ace19f33d136dbf27cd681b6b9.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_f8a8b8ace19f33d136dbf27cd681b6b9.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b68d90>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_af7dc7063821b64125a15751646650d0.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_af7dc7063821b64125a15751646650d0.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-28 11:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a11eda-652d-5f8e-80e7-402930d101e3 with scrape type 1
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 42a11eda-652d-5f8e-80e7-402930d101e3
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_fe64399006246d5866337993b12744ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_fe64399006246d5866337993b12744ff.jpg not downloaded yet
2026-03-28 11:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-28 11:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1eee54d-5421-5ab8-8769-bd0fe8b84449 with scrape type 1
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_6854380d8e31106791f9a62723df6d99.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6854380d8e31106791f9a62723df6d99.jpg not downloaded yet
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_28d585e74a673b9fa44f46afb0354cf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_28d585e74a673b9fa44f46afb0354cf3.jpg not downloaded yet
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_75c7731b345d0d9d79788442e68fa234.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_75c7731b345d0d9d79788442e68fa234.jpg not downloaded yet
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_c9b02909998e300a626ea5fbeda83f70.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_c9b02909998e300a626ea5fbeda83f70.jpg not downloaded yet
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_f71f25e26a5596dde644eca3f74487ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_654912baeb923d31379db490e8fc080a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_76fff0e049b83e4fb805416fac7ad004.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_76fff0e049b83e4fb805416fac7ad004.jpg not downloaded yet
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_7ea6757c0ea30396342624cfa1232b2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_7ea6757c0ea30396342624cfa1232b2f.jpg not downloaded yet
2026-03-28 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c319bf24f3584c031b040b8b64d596e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a0d150>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_19d6a12021b28d1990f408cfa44d2af7.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_19d6a12021b28d1990f408cfa44d2af7.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0acd150>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_3b1c560d4cf30c9f8474fe9a08bf4206.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b1c560d4cf30c9f8474fe9a08bf4206.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd3320450>
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_446e9b60086efcc404832db13e2c7fb3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_446e9b60086efcc404832db13e2c7fb3.jpg saved to cache
2026-03-28 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad0aba6a-691f-5c26-962e-c15486b0fbab
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_84965728f84dc68f33730c6bb3a6baec.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_84965728f84dc68f33730c6bb3a6baec.jpg not downloaded yet
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_69876e680551809a3c973b9388e5a37c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_69876e680551809a3c973b9388e5a37c.jpg not downloaded yet
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6854380d8e31106791f9a62723df6d99.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_13b1d10dbb17ef0350d92ef76c7ebab9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_e07352687b26c93b22a5c3708beb8b56.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_e07352687b26c93b22a5c3708beb8b56.jpg not downloaded yet
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_70e4fdd84b54e595501f4fe277e252e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_70e4fdd84b54e595501f4fe277e252e3.jpg not downloaded yet
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd3320cd0>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_f71f25e26a5596dde644eca3f74487ff.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_f71f25e26a5596dde644eca3f74487ff.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad0aba6a-691f-5c26-962e-c15486b0fbab
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b6efd0>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_654912baeb923d31379db490e8fc080a.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_654912baeb923d31379db490e8fc080a.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad0aba6a-691f-5c26-962e-c15486b0fbab
2026-03-28 11:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a12d90>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_c319bf24f3584c031b040b8b64d596e7.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c319bf24f3584c031b040b8b64d596e7.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_acbe7f332dbe04115774faaf3d88d66c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_fe64399006246d5866337993b12744ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_ca09763fda97dabc44fe0d61b0816b39.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_ca09763fda97dabc44fe0d61b0816b39.jpg not downloaded yet
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_10b56f3e598b6ed57a493908528124da.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_10b56f3e598b6ed57a493908528124da.jpg not downloaded yet
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_4477fa6e24d7d74b79962ae57e199a55.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_3a9c61232d45c9375348e1809656e6af.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_6b5185673d5a95a15e76da18cf74a0cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6b5185673d5a95a15e76da18cf74a0cd.jpg not downloaded yet
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd32c5c50>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_6854380d8e31106791f9a62723df6d99.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6854380d8e31106791f9a62723df6d99.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04af4d0>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_13b1d10dbb17ef0350d92ef76c7ebab9.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_13b1d10dbb17ef0350d92ef76c7ebab9.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad0aba6a-691f-5c26-962e-c15486b0fbab
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_c9b02909998e300a626ea5fbeda83f70.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_0c35a3a181ebd5e1e20f47d343f1222d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_0c35a3a181ebd5e1e20f47d343f1222d.jpg not downloaded yet
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_75c7731b345d0d9d79788442e68fa234.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_e5e91d00411ccb216699f064670ed52f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_e5e91d00411ccb216699f064670ed52f.jpg not downloaded yet
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_ce743e2a88e6807fc07a49d4394065b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_ce743e2a88e6807fc07a49d4394065b3.jpg not downloaded yet
2026-03-28 11:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a6d650>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_acbe7f332dbe04115774faaf3d88d66c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_acbe7f332dbe04115774faaf3d88d66c.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04cbe10>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_fe64399006246d5866337993b12744ff.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_fe64399006246d5866337993b12744ff.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42a11eda-652d-5f8e-80e7-402930d101e3
2026-03-28 11:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35be510>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_4477fa6e24d7d74b79962ae57e199a55.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_4477fa6e24d7d74b79962ae57e199a55.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08be4d0>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_3a9c61232d45c9375348e1809656e6af.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_3a9c61232d45c9375348e1809656e6af.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad0aba6a-691f-5c26-962e-c15486b0fbab
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_76fff0e049b83e4fb805416fac7ad004.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_28d585e74a673b9fa44f46afb0354cf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_7ea6757c0ea30396342624cfa1232b2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_84965728f84dc68f33730c6bb3a6baec.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0b54190>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_c9b02909998e300a626ea5fbeda83f70.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_c9b02909998e300a626ea5fbeda83f70.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d8d50>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_75c7731b345d0d9d79788442e68fa234.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_75c7731b345d0d9d79788442e68fa234.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42a11eda-652d-5f8e-80e7-402930d101e3
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_0239c8063bc2016b14c376ad0be785b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_e07352687b26c93b22a5c3708beb8b56.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c5a687fb175813eb36fdabb57b5c9405.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09b8910>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_76fff0e049b83e4fb805416fac7ad004.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_76fff0e049b83e4fb805416fac7ad004.jpg saved to cache
2026-03-28 11:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42a11eda-652d-5f8e-80e7-402930d101e3
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_ce743e2a88e6807fc07a49d4394065b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_e5e91d00411ccb216699f064670ed52f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_0c35a3a181ebd5e1e20f47d343f1222d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd08ed810>
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F78%252Fb478fb3500298190c003336e584b1088%252Fpa%252FUH00217_28d585e74a673b9fa44f46afb0354cf3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_28d585e74a673b9fa44f46afb0354cf3.jpg saved to cache
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad0aba6a-691f-5c26-962e-c15486b0fbab
2026-03-28 11:36:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad0aba6a-691f-5c26-962e-c15486b0fbab, skipping ID generation
2026-03-28 11:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad0aba6a-691f-5c26-962e-c15486b0fbab with scrape type 1
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad0aba6a-691f-5c26-962e-c15486b0fbab sending to next pipeline
2026-03-28 11:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad0aba6a-691f-5c26-962e-c15486b0fbab, identifier: UH00217
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13e9690>
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_7ea6757c0ea30396342624cfa1232b2f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_7ea6757c0ea30396342624cfa1232b2f.jpg saved to cache
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0a9f950>
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_84965728f84dc68f33730c6bb3a6baec.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_84965728f84dc68f33730c6bb3a6baec.jpg saved to cache
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42a11eda-652d-5f8e-80e7-402930d101e3
2026-03-28 11:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_ca09763fda97dabc44fe0d61b0816b39.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-28 11:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-28 11:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217 to the API
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_28d585e74a673b9fa44f46afb0354cf3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:02Z',
 'fuel_type': 'diesel',
 'id': 'ad0aba6a-691f-5c26-962e-c15486b0fbab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH00217',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 263712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_446e9b60086efcc404832db13e2c7fb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_f71f25e26a5596dde644eca3f74487ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_654912baeb923d31379db490e8fc080a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_13b1d10dbb17ef0350d92ef76c7ebab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_3a9c61232d45c9375348e1809656e6af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad0aba6a-691f-5c26-962e-c15486b0fbab/ad0aba6a-691f-5c26-962e-c15486b0fbab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/78/b478fb3500298190c003336e584b1088/pa/UH00217_28d585e74a673b9fa44f46afb0354cf3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.8 DI-D ClearTec EDITION',
 'transmission': 'manual',
 'trim': 'ClearTec EDITION',
 'year': 2012}
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-28 11:36:40 [auto1.be] INFO: Saving data for UH00217: {'created_time': 1774697800.667137, 'last_price_update_time': 1774697800.667146, 'auction_closing_time': 1774885082.0}
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UH00217') HTTP/1.1" 204 0
2026-03-28 11:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04a7f10>
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F1b%252F4b1b72c1d7995048731b4ba12793b8ba%252Fpa%252FZV95387_0239c8063bc2016b14c376ad0be785b3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_0239c8063bc2016b14c376ad0be785b3.jpg saved to cache
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b0881ec-6709-5d81-81b2-5054e324342b
2026-03-28 11:36:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b0881ec-6709-5d81-81b2-5054e324342b, skipping ID generation
2026-03-28 11:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0881ec-6709-5d81-81b2-5054e324342b with scrape type 1
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b0881ec-6709-5d81-81b2-5054e324342b sending to next pipeline
2026-03-28 11:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b0881ec-6709-5d81-81b2-5054e324342b, identifier: ZV95387
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04d2d10>
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_e07352687b26c93b22a5c3708beb8b56.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_e07352687b26c93b22a5c3708beb8b56.jpg saved to cache
2026-03-28 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42a11eda-652d-5f8e-80e7-402930d101e3
2026-03-28 11:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04b5290>
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4a%252F2a4a9407eeab67306f03ecad8ee32799%252Fpa%252FAG16412_c5a687fb175813eb36fdabb57b5c9405.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c5a687fb175813eb36fdabb57b5c9405.jpg saved to cache
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b
2026-03-28 11:36:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cc086b2-0d65-5036-b3a0-c7e36427d08b, skipping ID generation
2026-03-28 11:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b with scrape type 1
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b sending to next pipeline
2026-03-28 11:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2cc086b2-0d65-5036-b3a0-c7e36427d08b, identifier: AG16412
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd04b7c90>
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_ce743e2a88e6807fc07a49d4394065b3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_ce743e2a88e6807fc07a49d4394065b3.jpg saved to cache
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd146da50>
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_e5e91d00411ccb216699f064670ed52f.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_e5e91d00411ccb216699f064670ed52f.jpg saved to cache
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13f2110>
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_0c35a3a181ebd5e1e20f47d343f1222d.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_0c35a3a181ebd5e1e20f47d343f1222d.jpg saved to cache
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd0926cd0>
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fb2%252Fa6b2a89d720d1ffa3f09d6be92d4dfc9%252Fpa%252FSC10935_ca09763fda97dabc44fe0d61b0816b39.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_ca09763fda97dabc44fe0d61b0816b39.jpg saved to cache
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42a11eda-652d-5f8e-80e7-402930d101e3
2026-03-28 11:36:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42a11eda-652d-5f8e-80e7-402930d101e3, skipping ID generation
2026-03-28 11:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a11eda-652d-5f8e-80e7-402930d101e3 with scrape type 1
2026-03-28 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42a11eda-652d-5f8e-80e7-402930d101e3 sending to next pipeline
2026-03-28 11:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42a11eda-652d-5f8e-80e7-402930d101e3, identifier: SC10935
2026-03-28 11:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-28 11:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-28 11:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387 to the API
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_0239c8063bc2016b14c376ad0be785b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:59Z',
 'fuel_type': 'petrol',
 'id': '3b0881ec-6709-5d81-81b2-5054e324342b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV95387',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 84058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_1e1f32d71ffc00d98c03c12d6391651a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b50b34fa510fc15b81c6e89cd3cba14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_e1815d0d9c768e1ffa43182d1c0486ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_0239c8063bc2016b14c376ad0be785b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_a43793685309e67a49aadd29f33ef910.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_f8a8b8ace19f33d136dbf27cd681b6b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_36f2f70b58a44082107989be2a881391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_af7dc7063821b64125a15751646650d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_19d6a12021b28d1990f408cfa44d2af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0881ec-6709-5d81-81b2-5054e324342b/3b0881ec-6709-5d81-81b2-5054e324342b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/1b/4b1b72c1d7995048731b4ba12793b8ba/pa/ZV95387_3b1c560d4cf30c9f8474fe9a08bf4206.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-28 11:36:41 [auto1.be] INFO: Saving data for ZV95387: {'created_time': 1774697801.794006, 'last_price_update_time': 1774697801.794019, 'auction_closing_time': 1774885379.0}
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZV95387') HTTP/1.1" 204 0
2026-03-28 11:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-28 11:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-28 11:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412 to the API
2026-03-28 11:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c5a687fb175813eb36fdabb57b5c9405.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:02Z',
 'fuel_type': 'petrol',
 'id': '2cc086b2-0d65-5036-b3a0-c7e36427d08b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG16412',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 118041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3670782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_4477fa6e24d7d74b79962ae57e199a55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_89038caf1f4db7d46a90bad42f6668ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3442432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_acbe7f332dbe04115774faaf3d88d66c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2938997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c319bf24f3584c031b040b8b64d596e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_f92337f7ba4870357aa357c982363896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_3bafa35102187c5d4eae1de0dcbd8d24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178219,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_c5a687fb175813eb36fdabb57b5c9405.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_860614b9f2c52dfdaf557a0f91fee2bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_1a10dfc44e460e59c11b5077eef30a7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc086b2-0d65-5036-b3a0-c7e36427d08b/2cc086b2-0d65-5036-b3a0-c7e36427d08b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4a/2a4a9407eeab67306f03ecad8ee32799/pa/AG16412_80b44bcfeda0fc939066a3839c044425.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT Ambiente ultra',
 'transmission': 'automatic',
 'trim': 'Ambiente ultra',
 'year': 2014}
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-28 11:36:42 [auto1.be] INFO: Saving data for AG16412: {'created_time': 1774697802.152202, 'last_price_update_time': 1774697802.152214, 'auction_closing_time': 1774884422.0}
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG16412') HTTP/1.1" 204 0
2026-03-28 11:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-28 11:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-28 11:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935 to the API
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_ca09763fda97dabc44fe0d61b0816b39.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:58Z',
 'fuel_type': 'diesel',
 'id': '42a11eda-652d-5f8e-80e7-402930d101e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC10935',
 'listing': 'auction',
 'location': 'BE, Wanze',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 225479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_fe64399006246d5866337993b12744ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_75c7731b345d0d9d79788442e68fa234.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_76fff0e049b83e4fb805416fac7ad004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_84965728f84dc68f33730c6bb3a6baec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_e07352687b26c93b22a5c3708beb8b56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42a11eda-652d-5f8e-80e7-402930d101e3/42a11eda-652d-5f8e-80e7-402930d101e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/b2/a6b2a89d720d1ffa3f09d6be92d4dfc9/pa/SC10935_ca09763fda97dabc44fe0d61b0816b39.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.6 CDTI DPF Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2015}
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-28 11:36:42 [auto1.be] INFO: Saving data for SC10935: {'created_time': 1774697802.498061, 'last_price_update_time': 1774697802.498071, 'auction_closing_time': 1774883218.0}
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC10935') HTTP/1.1" 204 0
2026-03-28 11:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_69876e680551809a3c973b9388e5a37c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_70e4fdd84b54e595501f4fe277e252e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_10b56f3e598b6ed57a493908528124da.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6b5185673d5a95a15e76da18cf74a0cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:36:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd090c2d0>
2026-03-28 11:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_69876e680551809a3c973b9388e5a37c.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_69876e680551809a3c973b9388e5a37c.jpg saved to cache
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd09dac50>
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_70e4fdd84b54e595501f4fe277e252e3.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_70e4fdd84b54e595501f4fe277e252e3.jpg saved to cache
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd13af350>
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_10b56f3e598b6ed57a493908528124da.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_10b56f3e598b6ed57a493908528124da.jpg saved to cache
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f5cd35bde90>
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fbb%252Fa9bb60ddbefce4e12150c6580e0e2bd0%252Fpa%252FZZ39097_6b5185673d5a95a15e76da18cf74a0cd.jpg') HTTP/1.1" 204 0
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6b5185673d5a95a15e76da18cf74a0cd.jpg saved to cache
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1eee54d-5421-5ab8-8769-bd0fe8b84449
2026-03-28 11:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1eee54d-5421-5ab8-8769-bd0fe8b84449, skipping ID generation
2026-03-28 11:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1eee54d-5421-5ab8-8769-bd0fe8b84449 with scrape type 1
2026-03-28 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1eee54d-5421-5ab8-8769-bd0fe8b84449 sending to next pipeline
2026-03-28 11:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1eee54d-5421-5ab8-8769-bd0fe8b84449, identifier: ZZ39097
2026-03-28 11:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-28 11:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-28 11:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097 to the API
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6b5185673d5a95a15e76da18cf74a0cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:10Z',
 'fuel_type': 'diesel',
 'id': 'a1eee54d-5421-5ab8-8769-bd0fe8b84449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ39097',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 126244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6854380d8e31106791f9a62723df6d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_c9b02909998e300a626ea5fbeda83f70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_7ea6757c0ea30396342624cfa1232b2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2403376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_69876e680551809a3c973b9388e5a37c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_70e4fdd84b54e595501f4fe277e252e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_10b56f3e598b6ed57a493908528124da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_6b5185673d5a95a15e76da18cf74a0cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_0c35a3a181ebd5e1e20f47d343f1222d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_e5e91d00411ccb216699f064670ed52f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1eee54d-5421-5ab8-8769-bd0fe8b84449/a1eee54d-5421-5ab8-8769-bd0fe8b84449_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/bb/a9bb60ddbefce4e12150c6580e0e2bd0/pa/ZZ39097_ce743e2a88e6807fc07a49d4394065b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Pulsar 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-28 11:36:43 [auto1.be] INFO: Saving data for ZZ39097: {'created_time': 1774697803.877391, 'last_price_update_time': 1774697803.877401, 'auction_closing_time': 1774885450.0}
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ39097') HTTP/1.1" 204 0
2026-03-28 11:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:01 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-28 11:37:01 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC57264%27 HTTP/1.1" 200 None
2026-03-28 11:37:01 [auto1.be] INFO: Scrape type for PC57264: 0
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN83226%27 HTTP/1.1" 200 None
2026-03-28 11:37:01 [auto1.be] INFO: Scrape type for GN83226: 0
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD12029%27 HTTP/1.1" 200 None
2026-03-28 11:37:01 [auto1.be] INFO: Scrape type for RD12029: 0
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-28 11:37:01 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-28 11:37:01 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-28 11:37:01 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ07927%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for RZ07927: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR81556%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for LR81556: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ84188%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for UJ84188: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for JR35998: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW50978%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for TW50978: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE86423%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for GE86423: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE10158%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for AE10158: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW03008%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for PW03008: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ92015%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for DJ92015: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM94904%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for RM94904: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML32022%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for ML32022: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC12895%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for YC12895: 0
2026-03-28 11:37:02 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF46667%27 HTTP/1.1" 200 None
2026-03-28 11:37:02 [auto1.be] INFO: Scrape type for DF46667: 0
2026-03-28 11:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:03 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW94232%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for GW94232: 0
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD21641%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for TD21641: 0
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB55394%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for LB55394: 0
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for AX27110: 0
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB85934%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for GB85934: 0
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR37992%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for PR37992: 0
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for MD92482: 2
2026-03-28 11:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482
2026-03-28 11:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b144b57b-f96f-5fc4-b3db-37f849469388 with scrape type 2
2026-03-28 11:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b144b57b-f96f-5fc4-b3db-37f849469388 with scrape type 2
2026-03-28 11:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b144b57b-f96f-5fc4-b3db-37f849469388, identifier: MD92482
2026-03-28 11:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482
2026-03-28 11:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482
2026-03-28 11:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b144b57b-f96f-5fc4-b3db-37f849469388 with identifier: MD92482 to the API
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:45:13Z',
 'fuel_type': 'diesel',
 'id': 'b144b57b-f96f-5fc4-b3db-37f849469388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD92482',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 197173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Saving data for MD92482: {'auction_closing_time': 1774716313.0, 'created_time': 1774514151.919334, 'last_price_update_time': 1774697823.67088}
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD92482') HTTP/1.1" 204 0
2026-03-28 11:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 11:37:03 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL89741%27 HTTP/1.1" 200 None
2026-03-28 11:37:03 [auto1.be] INFO: Scrape type for HL89741: 2
2026-03-28 11:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741
2026-03-28 11:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with scrape type 2
2026-03-28 11:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with scrape type 2
2026-03-28 11:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba, identifier: HL89741
2026-03-28 11:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741
2026-03-28 11:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741
2026-03-28 11:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741 to the API
2026-03-28 11:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:43:38Z',
 'fuel_type': 'diesel',
 'id': '65dd1e9b-07f8-554c-a2f3-57e03f27d0ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL89741',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 203710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2017}
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL89741%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Saving data for HL89741: {'auction_closing_time': 1774716218.0, 'created_time': 1774427759.024696, 'last_price_update_time': 1774697824.181426}
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL89741') HTTP/1.1" 204 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for EK41744: 2
2026-03-28 11:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744
2026-03-28 11:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e838b482-319b-5424-b12a-fef0fae33720 with scrape type 2
2026-03-28 11:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e838b482-319b-5424-b12a-fef0fae33720 with scrape type 2
2026-03-28 11:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e838b482-319b-5424-b12a-fef0fae33720, identifier: EK41744
2026-03-28 11:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744
2026-03-28 11:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744
2026-03-28 11:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e838b482-319b-5424-b12a-fef0fae33720 with identifier: EK41744 to the API
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:28:14Z',
 'fuel_type': 'diesel',
 'id': 'e838b482-319b-5424-b12a-fef0fae33720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK41744',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 68250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-12',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Saving data for EK41744: {'auction_closing_time': 1774715294.0, 'created_time': 1773240292.775042, 'last_price_update_time': 1774697824.651118}
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK41744') HTTP/1.1" 204 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER13199%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for ER13199: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM74317%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for FM74317: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN70818%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for YN70818: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR10172%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for WR10172: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ60295%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for DZ60295: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-28 11:37:04 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-28 11:37:04 [auto1.be] INFO: Scrape type for GW87029: 2
2026-03-28 11:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029
2026-03-28 11:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a898b5b6-3de7-58d7-b50e-7e0904bf66ed with scrape type 2
2026-03-28 11:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a898b5b6-3de7-58d7-b50e-7e0904bf66ed with scrape type 2
2026-03-28 11:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a898b5b6-3de7-58d7-b50e-7e0904bf66ed, identifier: GW87029
2026-03-28 11:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029
2026-03-28 11:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029
2026-03-28 11:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a898b5b6-3de7-58d7-b50e-7e0904bf66ed with identifier: GW87029 to the API
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:51:14Z',
 'fuel_type': 'petrol',
 'id': 'a898b5b6-3de7-58d7-b50e-7e0904bf66ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW87029',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 95802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-12',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2007}
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-28 11:37:05 [auto1.be] INFO: Saving data for GW87029: {'auction_closing_time': 1774716674.0, 'created_time': 1774514146.988463, 'last_price_update_time': 1774697825.272875}
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW87029') HTTP/1.1" 204 0
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL95058%27 HTTP/1.1" 200 None
2026-03-28 11:37:05 [auto1.be] INFO: Scrape type for YL95058: 0
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY14138%27 HTTP/1.1" 200 None
2026-03-28 11:37:05 [auto1.be] INFO: Scrape type for BY14138: 0
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF17884%27 HTTP/1.1" 200 None
2026-03-28 11:37:05 [auto1.be] INFO: Scrape type for EF17884: 0
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-28 11:37:05 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-28 11:37:05 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-28 11:37:05 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-28 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:06 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN66713%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for CN66713: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ63633%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for EJ63633: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV18687%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for CV18687: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for NA97131: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for AM99393: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY49769%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for XY49769: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX92013%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for CX92013: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-28 11:37:06 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB34897%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Scrape type for YB34897: 2
2026-03-28 11:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897
2026-03-28 11:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1583b4f-d49b-54b2-9986-3ee13e10e56f with scrape type 2
2026-03-28 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1583b4f-d49b-54b2-9986-3ee13e10e56f with scrape type 2
2026-03-28 11:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1583b4f-d49b-54b2-9986-3ee13e10e56f, identifier: YB34897
2026-03-28 11:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897
2026-03-28 11:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897
2026-03-28 11:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897 to the API
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:41:14Z',
 'fuel_type': 'petrol',
 'id': 'f1583b4f-d49b-54b2-9986-3ee13e10e56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB34897',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 173798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-01',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2018}
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB34897%27 HTTP/1.1" 200 None
2026-03-28 11:37:06 [auto1.be] INFO: Saving data for YB34897: {'auction_closing_time': 1774716074.0, 'created_time': 1774038925.55209, 'last_price_update_time': 1774697826.94506}
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB34897') HTTP/1.1" 204 0
2026-03-28 11:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:07 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-28 11:37:07 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-28 11:37:07 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-28 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB62754%27 HTTP/1.1" 200 None
2026-03-28 11:37:07 [auto1.be] INFO: Scrape type for CB62754: 0
2026-03-28 11:37:07 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-28 11:37:07 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-28 11:37:07 [scrapy.extensions.logstats] INFO: Crawled 135 pages (at 32 pages/min), scraped 75 items (at 37 items/min)
2026-03-28 11:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:08 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE03465%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for KE03465: 2
2026-03-28 11:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465
2026-03-28 11:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with scrape type 2
2026-03-28 11:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with scrape type 2
2026-03-28 11:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1, identifier: KE03465
2026-03-28 11:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465
2026-03-28 11:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465
2026-03-28 11:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465 to the API
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:55:15Z',
 'fuel_type': 'diesel',
 'id': '9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE03465',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 107544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE03465%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Saving data for KE03465: {'auction_closing_time': 1774716915.0, 'created_time': 1774427738.492855, 'last_price_update_time': 1774697828.498807}
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE03465') HTTP/1.1" 204 0
2026-03-28 11:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84534%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for BR84534: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW31488%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for ZW31488: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE01185%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for JE01185: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE95179%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for CE95179: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT01513%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for JT01513: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for CP45384: 0
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-28 11:37:08 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-28 11:37:08 [auto1.be] INFO: Scrape type for AF68960: 2
2026-03-28 11:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960
2026-03-28 11:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with scrape type 2
2026-03-28 11:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with scrape type 2
2026-03-28 11:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d705c5e-83c1-5de2-aee8-f988ad5c0808, identifier: AF68960
2026-03-28 11:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960
2026-03-28 11:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960
2026-03-28 11:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d705c5e-83c1-5de2-aee8-f988ad5c0808 with identifier: AF68960 to the API
2026-03-28 11:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:44:54Z',
 'fuel_type': 'petrol',
 'id': '4d705c5e-83c1-5de2-aee8-f988ad5c0808',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF68960',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 64276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Limited 4x2',
 'transmission': 'manual',
 'trim': 'Limited 4x2',
 'year': 2021}
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-28 11:37:09 [auto1.be] INFO: Saving data for AF68960: {'auction_closing_time': 1774716294.0, 'created_time': 1774514152.283316, 'last_price_update_time': 1774697829.155235}
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF68960') HTTP/1.1" 204 0
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-28 11:37:09 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW00167%27 HTTP/1.1" 200 None
2026-03-28 11:37:09 [auto1.be] INFO: Scrape type for CW00167: 0
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-28 11:37:09 [auto1.be] INFO: Scrape type for BH52169: 2
2026-03-28 11:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-28 11:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with scrape type 2
2026-03-28 11:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with scrape type 2
2026-03-28 11:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0218965c-52a3-56e7-9b12-efd2fe68a2c0, identifier: BH52169
2026-03-28 11:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-28 11:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-28 11:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169 to the API
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:58:47Z',
 'fuel_type': 'diesel',
 'id': '0218965c-52a3-56e7-9b12-efd2fe68a2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH52169',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 149890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-29',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2012}
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-28 11:37:09 [auto1.be] INFO: Saving data for BH52169: {'auction_closing_time': 1774717127.0, 'created_time': 1773135185.488072, 'last_price_update_time': 1774697829.70646}
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BH52169') HTTP/1.1" 204 0
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-28 11:37:09 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-28 11:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:10 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:10 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 11:37:10 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-28 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG88652%27 HTTP/1.1" 200 None
2026-03-28 11:37:10 [auto1.be] INFO: Scrape type for NG88652: 0
2026-03-28 11:37:10 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-28 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP41015%27 HTTP/1.1" 200 None
2026-03-28 11:37:10 [auto1.be] INFO: Scrape type for NP41015: 2
2026-03-28 11:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229e2341-ed19-5078-bbd6-851c61540e7b with identifier: NP41015
2026-03-28 11:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229e2341-ed19-5078-bbd6-851c61540e7b with scrape type 2
2026-03-28 11:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229e2341-ed19-5078-bbd6-851c61540e7b with scrape type 2
2026-03-28 11:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 229e2341-ed19-5078-bbd6-851c61540e7b, identifier: NP41015
2026-03-28 11:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 229e2341-ed19-5078-bbd6-851c61540e7b with identifier: NP41015
2026-03-28 11:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 229e2341-ed19-5078-bbd6-851c61540e7b with identifier: NP41015
2026-03-28 11:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 229e2341-ed19-5078-bbd6-851c61540e7b with identifier: NP41015 to the API
2026-03-28 11:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:32:48Z',
 'fuel_type': 'diesel',
 'id': '229e2341-ed19-5078-bbd6-851c61540e7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP41015',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 200656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2019}
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP41015%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Saving data for NP41015: {'auction_closing_time': 1774715568.0, 'created_time': 1774125388.673876, 'last_price_update_time': 1774697831.094528}
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP41015') HTTP/1.1" 204 0
2026-03-28 11:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Scrape type for TX28125: 0
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ92859%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Scrape type for SJ92859: 2
2026-03-28 11:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ac5d71-eba7-5340-a959-7ac84477fd36 with identifier: SJ92859
2026-03-28 11:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ac5d71-eba7-5340-a959-7ac84477fd36 with scrape type 2
2026-03-28 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8ac5d71-eba7-5340-a959-7ac84477fd36 with scrape type 2
2026-03-28 11:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8ac5d71-eba7-5340-a959-7ac84477fd36, identifier: SJ92859
2026-03-28 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8ac5d71-eba7-5340-a959-7ac84477fd36 with identifier: SJ92859
2026-03-28 11:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8ac5d71-eba7-5340-a959-7ac84477fd36 with identifier: SJ92859
2026-03-28 11:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8ac5d71-eba7-5340-a959-7ac84477fd36 with identifier: SJ92859 to the API
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:22Z',
 'fuel_type': 'petrol',
 'id': 'd8ac5d71-eba7-5340-a959-7ac84477fd36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ92859',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 61569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2018}
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ92859%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Saving data for SJ92859: {'auction_closing_time': 1774715362.0, 'created_time': 1773822951.407535, 'last_price_update_time': 1774697831.644961}
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ92859') HTTP/1.1" 204 0
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB55358%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Scrape type for RB55358: 0
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL08078%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Scrape type for SL08078: 0
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-28 11:37:11 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49722%27 HTTP/1.1" 200 None
2026-03-28 11:37:11 [auto1.be] INFO: Scrape type for TE49722: 2
2026-03-28 11:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc0828c8-3d6a-59fe-b62b-a01c8984660c with identifier: TE49722
2026-03-28 11:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc0828c8-3d6a-59fe-b62b-a01c8984660c with scrape type 2
2026-03-28 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc0828c8-3d6a-59fe-b62b-a01c8984660c with scrape type 2
2026-03-28 11:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cc0828c8-3d6a-59fe-b62b-a01c8984660c, identifier: TE49722
2026-03-28 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cc0828c8-3d6a-59fe-b62b-a01c8984660c with identifier: TE49722
2026-03-28 11:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cc0828c8-3d6a-59fe-b62b-a01c8984660c with identifier: TE49722
2026-03-28 11:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cc0828c8-3d6a-59fe-b62b-a01c8984660c with identifier: TE49722 to the API
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:25:34Z',
 'fuel_type': 'diesel',
 'id': 'cc0828c8-3d6a-59fe-b62b-a01c8984660c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE49722',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 311538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-01',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49722%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Saving data for TE49722: {'auction_closing_time': 1774715134.0, 'created_time': 1773384535.98982, 'last_price_update_time': 1774697832.083806}
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TE49722') HTTP/1.1" 204 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU36315%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for PU36315: 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN37079%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for NN37079: 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for SZ91004: 2
2026-03-28 11:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004
2026-03-28 11:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64aa4d5-64ce-5705-9663-f0b9793f1120 with scrape type 2
2026-03-28 11:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64aa4d5-64ce-5705-9663-f0b9793f1120 with scrape type 2
2026-03-28 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f64aa4d5-64ce-5705-9663-f0b9793f1120, identifier: SZ91004
2026-03-28 11:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004
2026-03-28 11:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004
2026-03-28 11:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f64aa4d5-64ce-5705-9663-f0b9793f1120 with identifier: SZ91004 to the API
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:04:03Z',
 'fuel_type': 'hybrid',
 'id': 'f64aa4d5-64ce-5705-9663-f0b9793f1120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ91004',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 67655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-25',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Saving data for SZ91004: {'auction_closing_time': 1774713843.0, 'created_time': 1774039039.044946, 'last_price_update_time': 1774697832.608481}
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ91004') HTTP/1.1" 204 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ44217%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for WZ44217: 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR75863%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for NR75863: 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-28 11:37:12 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-28 11:37:12 [auto1.be] INFO: Scrape type for PE70540: 2
2026-03-28 11:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-28 11:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with scrape type 2
2026-03-28 11:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with scrape type 2
2026-03-28 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb, identifier: PE70540
2026-03-28 11:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-28 11:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-28 11:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540 to the API
2026-03-28 11:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:07:12Z',
 'fuel_type': 'petrol',
 'id': '9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE70540',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 184331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2013}
2026-03-28 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-28 11:37:13 [auto1.be] INFO: Saving data for PE70540: {'auction_closing_time': 1774714032.0, 'created_time': 1773239461.286606, 'last_price_update_time': 1774697833.111181}
2026-03-28 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE70540') HTTP/1.1" 204 0
2026-03-28 11:37:13 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 11:37:13 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-28 11:37:13 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-28 11:37:13 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-28 11:37:13 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-28 11:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:14 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP19111%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for SP19111: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF62281%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for BF62281: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM06752%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for KM06752: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ21578%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for KZ21578: 2
2026-03-28 11:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 931de540-0ee6-5236-8278-6bce0c4ff59b with identifier: KZ21578
2026-03-28 11:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 931de540-0ee6-5236-8278-6bce0c4ff59b with scrape type 2
2026-03-28 11:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 931de540-0ee6-5236-8278-6bce0c4ff59b with scrape type 2
2026-03-28 11:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 931de540-0ee6-5236-8278-6bce0c4ff59b, identifier: KZ21578
2026-03-28 11:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 931de540-0ee6-5236-8278-6bce0c4ff59b with identifier: KZ21578
2026-03-28 11:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 931de540-0ee6-5236-8278-6bce0c4ff59b with identifier: KZ21578
2026-03-28 11:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 931de540-0ee6-5236-8278-6bce0c4ff59b with identifier: KZ21578 to the API
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:39:08Z',
 'fuel_type': 'diesel',
 'id': '931de540-0ee6-5236-8278-6bce0c4ff59b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ21578',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 132411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 33 L2H2 Profi',
 'transmission': 'manual',
 'trim': '33 L2H2 Profi',
 'year': 2017}
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ21578%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Saving data for KZ21578: {'auction_closing_time': 1774715948.0, 'created_time': 1773240283.659427, 'last_price_update_time': 1774697834.611384}
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ21578') HTTP/1.1" 204 0
2026-03-28 11:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ29729%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for PJ29729: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for XT14784: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY27857%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for ZY27857: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX65189%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for NX65189: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN30379%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for WN30379: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for AX26323: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for DZ54195: 0
2026-03-28 11:37:14 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA45415%27 HTTP/1.1" 200 None
2026-03-28 11:37:14 [auto1.be] INFO: Scrape type for FA45415: 2
2026-03-28 11:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415
2026-03-28 11:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90d86897-f228-551e-83ea-bbca7ed1c09f with scrape type 2
2026-03-28 11:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90d86897-f228-551e-83ea-bbca7ed1c09f with scrape type 2
2026-03-28 11:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90d86897-f228-551e-83ea-bbca7ed1c09f, identifier: FA45415
2026-03-28 11:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415
2026-03-28 11:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415
2026-03-28 11:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415 to the API
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:55:31Z',
 'fuel_type': 'diesel',
 'id': '90d86897-f228-551e-83ea-bbca7ed1c09f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA45415',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 114652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Club Start&Stop',
 'transmission': 'manual',
 'trim': '33 L2H2 Club Start&Stop',
 'year': 2020}
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA45415%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Saving data for FA45415: {'auction_closing_time': 1774716931.0, 'created_time': 1773693616.100371, 'last_price_update_time': 1774697835.343556}
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA45415') HTTP/1.1" 204 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS89988%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for DS89988: 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY85639%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for HY85639: 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP50395%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for RP50395: 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM97787%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for XM97787: 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR57009%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for TR57009: 0
2026-03-28 11:37:15 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV70837%27 HTTP/1.1" 200 None
2026-03-28 11:37:15 [auto1.be] INFO: Scrape type for FV70837: 0
2026-03-28 11:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:16 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:16 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB39644%27 HTTP/1.1" 200 None
2026-03-28 11:37:16 [auto1.be] INFO: Scrape type for TB39644: 0
2026-03-28 11:37:16 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 11:37:16 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 11:37:16 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN95173%27 HTTP/1.1" 200 None
2026-03-28 11:37:16 [auto1.be] INFO: Scrape type for KN95173: 0
2026-03-28 11:37:16 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-28 11:37:16 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU34385%27 HTTP/1.1" 200 None
2026-03-28 11:37:16 [auto1.be] INFO: Scrape type for TU34385: 2
2026-03-28 11:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385
2026-03-28 11:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d004143a-8188-5706-9c65-cb140f369326 with scrape type 2
2026-03-28 11:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d004143a-8188-5706-9c65-cb140f369326 with scrape type 2
2026-03-28 11:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d004143a-8188-5706-9c65-cb140f369326, identifier: TU34385
2026-03-28 11:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385
2026-03-28 11:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385
2026-03-28 11:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385 to the API
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:29:53Z',
 'fuel_type': 'diesel',
 'id': 'd004143a-8188-5706-9c65-cb140f369326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU34385',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 176254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU34385%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Saving data for TU34385: {'auction_closing_time': 1774715393.0, 'created_time': 1774427750.871642, 'last_price_update_time': 1774697837.051489}
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU34385') HTTP/1.1" 204 0
2026-03-28 11:37:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB21597%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for RB21597: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC36147%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for DC36147: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV03405%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for TV03405: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT93863%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for PT93863: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT96766%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for UT96766: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF63760%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for NF63760: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for DD08232: 2
2026-03-28 11:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232
2026-03-28 11:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with scrape type 2
2026-03-28 11:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with scrape type 2
2026-03-28 11:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abbc6770-4925-5e9c-9ab1-3c1745cadbc2, identifier: DD08232
2026-03-28 11:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232
2026-03-28 11:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232
2026-03-28 11:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abbc6770-4925-5e9c-9ab1-3c1745cadbc2 with identifier: DD08232 to the API
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:03:46Z',
 'fuel_type': 'diesel',
 'id': 'abbc6770-4925-5e9c-9ab1-3c1745cadbc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD08232',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 232476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Saving data for DD08232: {'auction_closing_time': 1774713826.0, 'created_time': 1774125396.370517, 'last_price_update_time': 1774697837.734931}
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD08232') HTTP/1.1" 204 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32342%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for HU32342: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB89666%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for HB89666: 0
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-28 11:37:17 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-28 11:37:17 [auto1.be] INFO: Scrape type for DZ24480: 0
2026-03-28 11:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:18 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:18 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-28 11:37:18 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD48468%27 HTTP/1.1" 200 None
2026-03-28 11:37:18 [auto1.be] INFO: Scrape type for JD48468: 0
2026-03-28 11:37:18 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-28 11:37:18 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 11:37:18 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR78742%27 HTTP/1.1" 200 None
2026-03-28 11:37:18 [auto1.be] INFO: Scrape type for JR78742: 0
2026-03-28 11:37:18 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-28 11:37:18 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-28 11:37:18 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-28 11:37:18 [auto1.be] INFO: Scrape type for DF09339: 2
2026-03-28 11:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-28 11:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca9d3055-ca4d-5125-827c-f168fc7891c6 with scrape type 2
2026-03-28 11:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca9d3055-ca4d-5125-827c-f168fc7891c6 with scrape type 2
2026-03-28 11:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca9d3055-ca4d-5125-827c-f168fc7891c6, identifier: DF09339
2026-03-28 11:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-28 11:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-28 11:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339 to the API
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:18:34Z',
 'fuel_type': 'diesel',
 'id': 'ca9d3055-ca4d-5125-827c-f168fc7891c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF09339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 92653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-18',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2019}
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Saving data for DF09339: {'auction_closing_time': 1774714714.0, 'created_time': 1774341336.667129, 'last_price_update_time': 1774697839.292701}
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF09339') HTTP/1.1" 204 0
2026-03-28 11:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE77274%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for VE77274: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN88473%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for AN88473: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD10151%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for DD10151: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH59922%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for TH59922: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ74735%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for CZ74735: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ90167%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for YZ90167: 0
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-28 11:37:19 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-28 11:37:19 [auto1.be] INFO: Scrape type for RV20515: 2
2026-03-28 11:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-28 11:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with scrape type 2
2026-03-28 11:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with scrape type 2
2026-03-28 11:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b, identifier: RV20515
2026-03-28 11:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-28 11:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-28 11:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515 to the API
2026-03-28 11:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:19:12Z',
 'fuel_type': 'petrol',
 'id': '7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV20515',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 38986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2022}
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-28 11:37:20 [auto1.be] INFO: Saving data for RV20515: {'auction_closing_time': 1774714752.0, 'created_time': 1774039063.593968, 'last_price_update_time': 1774697840.771547}
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RV20515') HTTP/1.1" 204 0
2026-03-28 11:37:20 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS47672%27 HTTP/1.1" 200 None
2026-03-28 11:37:20 [auto1.be] INFO: Scrape type for VS47672: 0
2026-03-28 11:37:20 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-28 11:37:20 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-28 11:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:22 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ90658%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for BZ90658: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ31869%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for JZ31869: 2
2026-03-28 11:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869
2026-03-28 11:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05701f22-1ae1-5234-9244-c64b3f17a6e1 with scrape type 2
2026-03-28 11:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05701f22-1ae1-5234-9244-c64b3f17a6e1 with scrape type 2
2026-03-28 11:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 05701f22-1ae1-5234-9244-c64b3f17a6e1, identifier: JZ31869
2026-03-28 11:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869
2026-03-28 11:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869
2026-03-28 11:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869 to the API
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:20:24Z',
 'fuel_type': 'petrol',
 'id': '05701f22-1ae1-5234-9244-c64b3f17a6e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ31869',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 133471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ31869%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Saving data for JZ31869: {'auction_closing_time': 1774714824.0, 'created_time': 1773693830.126407, 'last_price_update_time': 1774697842.721251}
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ31869') HTTP/1.1" 204 0
2026-03-28 11:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK49914%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for YK49914: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for TG38013: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for BN53670: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for NN42676: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for GC32489: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-28 11:37:22 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP70532%27 HTTP/1.1" 200 None
2026-03-28 11:37:22 [auto1.be] INFO: Scrape type for WP70532: 2
2026-03-28 11:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532
2026-03-28 11:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with scrape type 2
2026-03-28 11:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with scrape type 2
2026-03-28 11:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a80c4c9a-7073-52b6-9878-69e8f2d3cae5, identifier: WP70532
2026-03-28 11:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532
2026-03-28 11:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532
2026-03-28 11:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532 to the API
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:15:52Z',
 'fuel_type': 'diesel',
 'id': 'a80c4c9a-7073-52b6-9878-69e8f2d3cae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP70532',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 67256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Longitude 4WD',
 'transmission': 'automatic',
 'trim': 'Longitude 4WD',
 'year': 2020}
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP70532%27 HTTP/1.1" 200 None
2026-03-28 11:37:23 [auto1.be] INFO: Saving data for WP70532: {'auction_closing_time': 1774714552.0, 'created_time': 1774427760.78505, 'last_price_update_time': 1774697843.250548}
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP70532') HTTP/1.1" 204 0
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-28 11:37:23 [auto1.be] INFO: Scrape type for AN69845: 2
2026-03-28 11:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845
2026-03-28 11:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bac3a6f-da33-5aca-9a98-10d4db848e4c with scrape type 2
2026-03-28 11:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bac3a6f-da33-5aca-9a98-10d4db848e4c with scrape type 2
2026-03-28 11:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bac3a6f-da33-5aca-9a98-10d4db848e4c, identifier: AN69845
2026-03-28 11:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845
2026-03-28 11:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845
2026-03-28 11:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bac3a6f-da33-5aca-9a98-10d4db848e4c with identifier: AN69845 to the API
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:44Z',
 'fuel_type': 'diesel',
 'id': '2bac3a6f-da33-5aca-9a98-10d4db848e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN69845',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 170119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-22',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-28 11:37:23 [auto1.be] INFO: Saving data for AN69845: {'auction_closing_time': 1774717124.0, 'created_time': 1774514136.819731, 'last_price_update_time': 1774697843.757583}
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AN69845') HTTP/1.1" 204 0
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-28 11:37:23 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH50870%27 HTTP/1.1" 200 None
2026-03-28 11:37:23 [auto1.be] INFO: Scrape type for AH50870: 0
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-28 11:37:23 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-28 11:37:23 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF91319%27 HTTP/1.1" 200 None
2026-03-28 11:37:23 [auto1.be] INFO: Scrape type for TF91319: 2
2026-03-28 11:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66e01dc-8b18-5996-929a-a93f14b3d11b with identifier: TF91319
2026-03-28 11:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66e01dc-8b18-5996-929a-a93f14b3d11b with scrape type 2
2026-03-28 11:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d66e01dc-8b18-5996-929a-a93f14b3d11b with scrape type 2
2026-03-28 11:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d66e01dc-8b18-5996-929a-a93f14b3d11b, identifier: TF91319
2026-03-28 11:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d66e01dc-8b18-5996-929a-a93f14b3d11b with identifier: TF91319
2026-03-28 11:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d66e01dc-8b18-5996-929a-a93f14b3d11b with identifier: TF91319
2026-03-28 11:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d66e01dc-8b18-5996-929a-a93f14b3d11b with identifier: TF91319 to the API
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:39Z',
 'fuel_type': 'diesel',
 'id': 'd66e01dc-8b18-5996-929a-a93f14b3d11b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF91319',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 256020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF91319%27 HTTP/1.1" 200 None
2026-03-28 11:37:24 [auto1.be] INFO: Saving data for TF91319: {'auction_closing_time': 1774716279.0, 'created_time': 1774514134.150984, 'last_price_update_time': 1774697844.270017}
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF91319') HTTP/1.1" 204 0
2026-03-28 11:37:24 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 11:37:24 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-28 11:37:24 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-28 11:37:24 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-28 11:37:24 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-28 11:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:25 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS30497%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for KS30497: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08447%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for GU08447: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE01545%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for SE01545: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF05397%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for JF05397: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV64637%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for ZV64637: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS12412%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for JS12412: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW35122%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for YW35122: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP65458%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for VP65458: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK31036%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for XK31036: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-28 11:37:25 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-28 11:37:25 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-28 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-28 11:37:26 [auto1.be] INFO: Scrape type for TH69152: 0
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM09750%27 HTTP/1.1" 200 None
2026-03-28 11:37:26 [auto1.be] INFO: Scrape type for UM09750: 0
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM78271%27 HTTP/1.1" 200 None
2026-03-28 11:37:26 [auto1.be] INFO: Scrape type for KM78271: 2
2026-03-28 11:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271
2026-03-28 11:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c63d67-b840-5d01-83b1-0c68b59f4098 with scrape type 2
2026-03-28 11:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73c63d67-b840-5d01-83b1-0c68b59f4098 with scrape type 2
2026-03-28 11:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73c63d67-b840-5d01-83b1-0c68b59f4098, identifier: KM78271
2026-03-28 11:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271
2026-03-28 11:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271
2026-03-28 11:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271 to the API
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-28T16:50:34Z',
 'fuel_type': 'petrol',
 'id': '73c63d67-b840-5d01-83b1-0c68b59f4098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM78271',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 137278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-21',
 'seller_name': None,
 'title': 'Volvo V60 1.5 Linje Svart',
 'transmission': 'automatic',
 'trim': 'Linje Svart',
 'year': 2018}
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM78271%27 HTTP/1.1" 200 None
2026-03-28 11:37:26 [auto1.be] INFO: Saving data for KM78271: {'auction_closing_time': 1774716634.0, 'created_time': 1773225325.019378, 'last_price_update_time': 1774697846.455788}
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM78271') HTTP/1.1" 204 0
2026-03-28 11:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-28 11:37:26 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 11:37:26 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET07668%27 HTTP/1.1" 200 None
2026-03-28 11:37:26 [auto1.be] INFO: Scrape type for ET07668: 2
2026-03-28 11:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668
2026-03-28 11:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with scrape type 2
2026-03-28 11:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with scrape type 2
2026-03-28 11:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2688a6cd-bd9b-5d39-9ccc-13847ccac833, identifier: ET07668
2026-03-28 11:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668
2026-03-28 11:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668
2026-03-28 11:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668 to the API
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:18:12Z',
 'fuel_type': 'diesel',
 'id': '2688a6cd-bd9b-5d39-9ccc-13847ccac833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET07668',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 144898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L2H1 1,2t Family',
 'transmission': 'manual',
 'trim': 'L2H1 1,2t Family',
 'year': 2018}
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET07668%27 HTTP/1.1" 200 None
2026-03-28 11:37:27 [auto1.be] INFO: Saving data for ET07668: {'auction_closing_time': 1774714692.0, 'created_time': 1773240573.952635, 'last_price_update_time': 1774697847.026358}
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET07668') HTTP/1.1" 204 0
2026-03-28 11:37:27 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 11:37:27 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE24792%27 HTTP/1.1" 200 None
2026-03-28 11:37:27 [auto1.be] INFO: Scrape type for WE24792: 0
2026-03-28 11:37:27 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP41494%27 HTTP/1.1" 200 None
2026-03-28 11:37:27 [auto1.be] INFO: Scrape type for SP41494: 0
2026-03-28 11:37:27 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA31821%27 HTTP/1.1" 200 None
2026-03-28 11:37:27 [auto1.be] INFO: Scrape type for YA31821: 0
2026-03-28 11:37:27 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 11:37:27 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 11:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:28 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1820 | hits on page: 40
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-28 11:37:28 [auto1.be] INFO: Scrape type for RJ01486: 2
2026-03-28 11:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-28 11:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with scrape type 2
2026-03-28 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with scrape type 2
2026-03-28 11:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f, identifier: RJ01486
2026-03-28 11:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-28 11:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-28 11:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486 to the API
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:28:41Z',
 'fuel_type': 'petrol',
 'id': '4ea3fdf4-850d-5507-bda1-a0321c4b8a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ01486',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 118811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-28 11:37:28 [auto1.be] INFO: Saving data for RJ01486: {'auction_closing_time': 1774715321.0, 'created_time': 1773133983.568671, 'last_price_update_time': 1774697848.479152}
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ01486') HTTP/1.1" 204 0
2026-03-28 11:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS83423%27 HTTP/1.1" 200 None
2026-03-28 11:37:28 [auto1.be] INFO: Scrape type for MS83423: 0
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ35563%27 HTTP/1.1" 200 None
2026-03-28 11:37:28 [auto1.be] INFO: Scrape type for RJ35563: 0
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 11:37:28 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-28 11:37:28 [auto1.be] INFO: Scrape type for NJ53644: 2
2026-03-28 11:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-28 11:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44623cf2-fece-58a6-9429-68a52afad111 with scrape type 2
2026-03-28 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44623cf2-fece-58a6-9429-68a52afad111 with scrape type 2
2026-03-28 11:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44623cf2-fece-58a6-9429-68a52afad111, identifier: NJ53644
2026-03-28 11:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-28 11:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-28 11:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644 to the API
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:40:03Z',
 'fuel_type': 'diesel',
 'id': '44623cf2-fece-58a6-9429-68a52afad111',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ53644',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 215236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-01',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2015}
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-28 11:37:29 [auto1.be] INFO: Saving data for NJ53644: {'auction_closing_time': 1774716003.0, 'created_time': 1773133167.364383, 'last_price_update_time': 1774697849.063746}
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ53644') HTTP/1.1" 204 0
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-28 11:37:29 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-28 11:37:29 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW54495%27 HTTP/1.1" 200 None
2026-03-28 11:37:29 [auto1.be] INFO: Scrape type for KW54495: 2
2026-03-28 11:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6876f3d5-b10c-59cd-8ec1-f398ee82d678 with identifier: KW54495
2026-03-28 11:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6876f3d5-b10c-59cd-8ec1-f398ee82d678 with scrape type 2
2026-03-28 11:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6876f3d5-b10c-59cd-8ec1-f398ee82d678 with scrape type 2
2026-03-28 11:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6876f3d5-b10c-59cd-8ec1-f398ee82d678, identifier: KW54495
2026-03-28 11:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6876f3d5-b10c-59cd-8ec1-f398ee82d678 with identifier: KW54495
2026-03-28 11:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6876f3d5-b10c-59cd-8ec1-f398ee82d678 with identifier: KW54495
2026-03-28 11:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6876f3d5-b10c-59cd-8ec1-f398ee82d678 with identifier: KW54495 to the API
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:50:36Z',
 'fuel_type': 'diesel',
 'id': '6876f3d5-b10c-59cd-8ec1-f398ee82d678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW54495',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 94611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2011}
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW54495%27 HTTP/1.1" 200 None
2026-03-28 11:37:29 [auto1.be] INFO: Saving data for KW54495: {'auction_closing_time': 1774716636.0, 'created_time': 1774514160.46624, 'last_price_update_time': 1774697849.520411}
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW54495') HTTP/1.1" 204 0
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 11:37:29 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-28 11:37:29 [auto1.be] INFO: Scrape type for UW48678: 2
2026-03-28 11:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678
2026-03-28 11:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee790633-e426-568c-aa57-a78c4bccbd87 with scrape type 2
2026-03-28 11:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee790633-e426-568c-aa57-a78c4bccbd87 with scrape type 2
2026-03-28 11:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee790633-e426-568c-aa57-a78c4bccbd87, identifier: UW48678
2026-03-28 11:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678
2026-03-28 11:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678
2026-03-28 11:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee790633-e426-568c-aa57-a78c4bccbd87 with identifier: UW48678 to the API
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:52Z',
 'fuel_type': 'diesel',
 'id': 'ee790633-e426-568c-aa57-a78c4bccbd87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW48678',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 157231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Audi A3 Limousine 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2015}
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Saving data for UW48678: {'auction_closing_time': 1774714012.0, 'created_time': 1774514148.987244, 'last_price_update_time': 1774697850.050136}
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW48678') HTTP/1.1" 204 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW19960%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for EW19960: 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL30706%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for VL30706: 2
2026-03-28 11:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5407c329-5c79-516a-8d4a-dd1dd75e138b with identifier: VL30706
2026-03-28 11:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5407c329-5c79-516a-8d4a-dd1dd75e138b with scrape type 2
2026-03-28 11:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5407c329-5c79-516a-8d4a-dd1dd75e138b with scrape type 2
2026-03-28 11:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5407c329-5c79-516a-8d4a-dd1dd75e138b, identifier: VL30706
2026-03-28 11:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5407c329-5c79-516a-8d4a-dd1dd75e138b with identifier: VL30706
2026-03-28 11:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5407c329-5c79-516a-8d4a-dd1dd75e138b with identifier: VL30706
2026-03-28 11:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5407c329-5c79-516a-8d4a-dd1dd75e138b with identifier: VL30706 to the API
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:08:15Z',
 'fuel_type': 'petrol',
 'id': '5407c329-5c79-516a-8d4a-dd1dd75e138b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL30706',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 83383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2012}
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL30706%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Saving data for VL30706: {'auction_closing_time': 1774714095.0, 'created_time': 1774514156.306917, 'last_price_update_time': 1774697850.471543}
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL30706') HTTP/1.1" 204 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44813%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for DT44813: 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS77634%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for GS77634: 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH29158%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for NH29158: 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY53822%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for DY53822: 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA35148%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for RA35148: 0
2026-03-28 11:37:30 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-28 11:37:30 [auto1.be] INFO: Scrape type for GF59002: 2
2026-03-28 11:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002
2026-03-28 11:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b307dbf-534f-5af8-9ac2-99336b8f5895 with scrape type 2
2026-03-28 11:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b307dbf-534f-5af8-9ac2-99336b8f5895 with scrape type 2
2026-03-28 11:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b307dbf-534f-5af8-9ac2-99336b8f5895, identifier: GF59002
2026-03-28 11:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002
2026-03-28 11:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002
2026-03-28 11:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b307dbf-534f-5af8-9ac2-99336b8f5895 with identifier: GF59002 to the API
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:48:38Z',
 'fuel_type': 'petrol',
 'id': '6b307dbf-534f-5af8-9ac2-99336b8f5895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF59002',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 61973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-28 11:37:31 [auto1.be] INFO: Saving data for GF59002: {'auction_closing_time': 1774716518.0, 'created_time': 1773822927.639751, 'last_price_update_time': 1774697851.020911}
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF59002') HTTP/1.1" 204 0
2026-03-28 11:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:31 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1821 | hits on page: 40
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-28 11:37:31 [auto1.be] INFO: Scrape type for GF59002: 0
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-28 11:37:31 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-28 11:37:31 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB43323%27 HTTP/1.1" 200 None
2026-03-28 11:37:31 [auto1.be] INFO: Scrape type for EB43323: 0
2026-03-28 11:37:31 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-28 11:37:31 [auto1.be] INFO: Scrape type for PV35906: 2
2026-03-28 11:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-28 11:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e909e59a-6370-539e-96ba-297396904918 with scrape type 2
2026-03-28 11:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e909e59a-6370-539e-96ba-297396904918 with scrape type 2
2026-03-28 11:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e909e59a-6370-539e-96ba-297396904918, identifier: PV35906
2026-03-28 11:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-28 11:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-28 11:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906 to the API
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:20:11Z',
 'fuel_type': 'petrol',
 'id': 'e909e59a-6370-539e-96ba-297396904918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV35906',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 23331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-19',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2023}
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Saving data for PV35906: {'auction_closing_time': 1774714811.0, 'created_time': 1773132023.169378, 'last_price_update_time': 1774697852.084788}
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV35906') HTTP/1.1" 204 0
2026-03-28 11:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for SR71847: 2
2026-03-28 11:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-28 11:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01837aeb-71bd-5171-ac3c-963900840840 with scrape type 2
2026-03-28 11:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01837aeb-71bd-5171-ac3c-963900840840 with scrape type 2
2026-03-28 11:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01837aeb-71bd-5171-ac3c-963900840840, identifier: SR71847
2026-03-28 11:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-28 11:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-28 11:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847 to the API
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:10:13Z',
 'fuel_type': 'petrol',
 'id': '01837aeb-71bd-5171-ac3c-963900840840',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR71847',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 74167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-01',
 'seller_name': None,
 'title': 'Toyota Verso 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Saving data for SR71847: {'auction_closing_time': 1774714213.0, 'created_time': 1773301671.47644, 'last_price_update_time': 1774697852.637211}
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR71847') HTTP/1.1" 204 0
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: US70780
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH06099%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for JH06099: 0
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ27954%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for WJ27954: 0
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR58381%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for TR58381: 0
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM08929%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for WM08929: 0
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for YN20871: 0
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-28 11:37:32 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS04385%27 HTTP/1.1" 200 None
2026-03-28 11:37:32 [auto1.be] INFO: Scrape type for HS04385: 2
2026-03-28 11:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385
2026-03-28 11:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a836947a-3d99-545e-8faa-11bc37e87ffc with scrape type 2
2026-03-28 11:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a836947a-3d99-545e-8faa-11bc37e87ffc with scrape type 2
2026-03-28 11:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a836947a-3d99-545e-8faa-11bc37e87ffc, identifier: HS04385
2026-03-28 11:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385
2026-03-28 11:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385
2026-03-28 11:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385 to the API
2026-03-28 11:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:17Z',
 'fuel_type': 'diesel',
 'id': 'a836947a-3d99-545e-8faa-11bc37e87ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS04385',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 182322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2018}
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS04385%27 HTTP/1.1" 200 None
2026-03-28 11:37:33 [auto1.be] INFO: Saving data for HS04385: {'auction_closing_time': 1774714457.0, 'created_time': 1773780039.807142, 'last_price_update_time': 1774697853.17514}
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS04385') HTTP/1.1" 204 0
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-28 11:37:33 [auto1.be] INFO: Scrape type for FV41606: 2
2026-03-28 11:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606
2026-03-28 11:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e562bb-4d42-55be-b4e3-364202ff78db with scrape type 2
2026-03-28 11:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e562bb-4d42-55be-b4e3-364202ff78db with scrape type 2
2026-03-28 11:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 83e562bb-4d42-55be-b4e3-364202ff78db, identifier: FV41606
2026-03-28 11:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606
2026-03-28 11:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606
2026-03-28 11:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606 to the API
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:45:28Z',
 'fuel_type': 'petrol',
 'id': '83e562bb-4d42-55be-b4e3-364202ff78db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV41606',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 93280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-19',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2017}
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-28 11:37:33 [auto1.be] INFO: Saving data for FV41606: {'auction_closing_time': 1774716328.0, 'created_time': 1774125438.538684, 'last_price_update_time': 1774697853.681255}
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV41606') HTTP/1.1" 204 0
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN50786%27 HTTP/1.1" 200 None
2026-03-28 11:37:33 [auto1.be] INFO: Scrape type for YN50786: 0
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM09652%27 HTTP/1.1" 200 None
2026-03-28 11:37:33 [auto1.be] INFO: Scrape type for CM09652: 0
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 11:37:33 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-28 11:37:33 [auto1.be] INFO: Scrape type for JW06840: 2
2026-03-28 11:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840
2026-03-28 11:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a56e16-7835-58e3-8a1a-70b89c9f0910 with scrape type 2
2026-03-28 11:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a56e16-7835-58e3-8a1a-70b89c9f0910 with scrape type 2
2026-03-28 11:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9a56e16-7835-58e3-8a1a-70b89c9f0910, identifier: JW06840
2026-03-28 11:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840
2026-03-28 11:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840
2026-03-28 11:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9a56e16-7835-58e3-8a1a-70b89c9f0910 with identifier: JW06840 to the API
2026-03-28 11:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:05Z',
 'fuel_type': 'diesel',
 'id': 'b9a56e16-7835-58e3-8a1a-70b89c9f0910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW06840',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 136703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-28 11:37:34 [auto1.be] INFO: Saving data for JW06840: {'auction_closing_time': 1774716845.0, 'created_time': 1774514156.644548, 'last_price_update_time': 1774697854.107918}
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW06840') HTTP/1.1" 204 0
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-28 11:37:34 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL97420%27 HTTP/1.1" 200 None
2026-03-28 11:37:34 [auto1.be] INFO: Scrape type for TL97420: 0
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-28 11:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:34 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1821 | hits on page: 40
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05336%27 HTTP/1.1" 200 None
2026-03-28 11:37:34 [auto1.be] INFO: Scrape type for GS05336: 0
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU70188%27 HTTP/1.1" 200 None
2026-03-28 11:37:34 [auto1.be] INFO: Scrape type for JU70188: 0
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-28 11:37:34 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK84429%27 HTTP/1.1" 200 None
2026-03-28 11:37:34 [auto1.be] INFO: Scrape type for RK84429: 0
2026-03-28 11:37:34 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK31159%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Scrape type for DK31159: 0
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU76581%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Scrape type for MU76581: 2
2026-03-28 11:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581
2026-03-28 11:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with scrape type 2
2026-03-28 11:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with scrape type 2
2026-03-28 11:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70, identifier: MU76581
2026-03-28 11:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581
2026-03-28 11:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581
2026-03-28 11:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581 to the API
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:11Z',
 'fuel_type': 'petrol',
 'id': '6b76b8ee-2495-54f1-8e45-a9c301cc4e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU76581',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 77329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-04',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU76581%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Saving data for MU76581: {'auction_closing_time': 1774716611.0, 'created_time': 1774427754.837633, 'last_price_update_time': 1774697855.456909}
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MU76581') HTTP/1.1" 204 0
2026-03-28 11:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-28 11:37:35 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45818%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Scrape type for EJ45818: 2
2026-03-28 11:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818
2026-03-28 11:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e9a68e-0189-5d58-a461-9d7b181b6ebc with scrape type 2
2026-03-28 11:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20e9a68e-0189-5d58-a461-9d7b181b6ebc with scrape type 2
2026-03-28 11:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20e9a68e-0189-5d58-a461-9d7b181b6ebc, identifier: EJ45818
2026-03-28 11:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818
2026-03-28 11:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818
2026-03-28 11:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818 to the API
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:52:10Z',
 'fuel_type': 'hybrid',
 'id': '20e9a68e-0189-5d58-a461-9d7b181b6ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ45818',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 153228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-20',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45818%27 HTTP/1.1" 200 None
2026-03-28 11:37:35 [auto1.be] INFO: Saving data for EJ45818: {'auction_closing_time': 1774716730.0, 'created_time': 1773136471.778212, 'last_price_update_time': 1774697855.991739}
2026-03-28 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ45818') HTTP/1.1" 204 0
2026-03-28 11:37:36 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX63908%27 HTTP/1.1" 200 None
2026-03-28 11:37:36 [auto1.be] INFO: Scrape type for WX63908: 0
2026-03-28 11:37:36 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL53364%27 HTTP/1.1" 200 None
2026-03-28 11:37:36 [auto1.be] INFO: Scrape type for RL53364: 2
2026-03-28 11:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364
2026-03-28 11:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287e9706-619d-5169-844e-d9e9e41c15c5 with scrape type 2
2026-03-28 11:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287e9706-619d-5169-844e-d9e9e41c15c5 with scrape type 2
2026-03-28 11:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 287e9706-619d-5169-844e-d9e9e41c15c5, identifier: RL53364
2026-03-28 11:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 11:37:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364
2026-03-28 11:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364 to the API
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:18:02Z',
 'fuel_type': 'petrol',
 'id': '287e9706-619d-5169-844e-d9e9e41c15c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL53364',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 124763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-05',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL53364%27 HTTP/1.1" 200 None
2026-03-28 11:37:36 [auto1.be] INFO: Saving data for RL53364: {'auction_closing_time': 1774714682.0, 'created_time': 1773239495.172672, 'last_price_update_time': 1774697856.543577}
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL53364') HTTP/1.1" 204 0
2026-03-28 11:37:36 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-28 11:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:37 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1821 | hits on page: 40
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-28 11:37:37 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM52966%27 HTTP/1.1" 200 None
2026-03-28 11:37:37 [auto1.be] INFO: Scrape type for SM52966: 0
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-28 11:37:37 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-28 11:37:37 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR59063%27 HTTP/1.1" 200 None
2026-03-28 11:37:37 [auto1.be] INFO: Scrape type for FR59063: 2
2026-03-28 11:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063
2026-03-28 11:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with scrape type 2
2026-03-28 11:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with scrape type 2
2026-03-28 11:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1868b9b-c402-57ab-b4b1-d96a4586dcf0, identifier: FR59063
2026-03-28 11:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063
2026-03-28 11:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063
2026-03-28 11:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063 to the API
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:40:13Z',
 'fuel_type': 'diesel',
 'id': 'a1868b9b-c402-57ab-b4b1-d96a4586dcf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR59063',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 216035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-13',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR59063%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Saving data for FR59063: {'auction_closing_time': 1774716013.0, 'created_time': 1774427746.551026, 'last_price_update_time': 1774697858.052562}
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR59063') HTTP/1.1" 204 0
2026-03-28 11:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ82774%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for BZ82774: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS18318%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for KS18318: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW21160%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for MW21160: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK67306%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for FK67306: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for TF58036: 2
2026-03-28 11:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036
2026-03-28 11:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a5c319-9284-5962-b60b-a93cbc7a19b9 with scrape type 2
2026-03-28 11:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a5c319-9284-5962-b60b-a93cbc7a19b9 with scrape type 2
2026-03-28 11:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7a5c319-9284-5962-b60b-a93cbc7a19b9, identifier: TF58036
2026-03-28 11:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036
2026-03-28 11:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036
2026-03-28 11:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7a5c319-9284-5962-b60b-a93cbc7a19b9 with identifier: TF58036 to the API
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:37:04Z',
 'fuel_type': 'diesel',
 'id': 'b7a5c319-9284-5962-b60b-a93cbc7a19b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF58036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 202139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-09',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2017}
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Saving data for TF58036: {'auction_closing_time': 1774715824.0, 'created_time': 1774514169.588226, 'last_price_update_time': 1774697858.723224}
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF58036') HTTP/1.1" 204 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE17510%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for KE17510: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-28 11:37:38 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-28 11:37:38 [auto1.be] INFO: Scrape type for HJ27727: 0
2026-03-28 11:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:39 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1821 | hits on page: 40
2026-03-28 11:37:39 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-28 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP97194%27 HTTP/1.1" 200 None
2026-03-28 11:37:39 [auto1.be] INFO: Scrape type for AP97194: 2
2026-03-28 11:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 546ade60-09b8-52fc-aff9-241aabc61a39 with identifier: AP97194
2026-03-28 11:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 546ade60-09b8-52fc-aff9-241aabc61a39 with scrape type 2
2026-03-28 11:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 546ade60-09b8-52fc-aff9-241aabc61a39 with scrape type 2
2026-03-28 11:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 546ade60-09b8-52fc-aff9-241aabc61a39, identifier: AP97194
2026-03-28 11:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 546ade60-09b8-52fc-aff9-241aabc61a39 with identifier: AP97194
2026-03-28 11:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 546ade60-09b8-52fc-aff9-241aabc61a39 with identifier: AP97194
2026-03-28 11:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 546ade60-09b8-52fc-aff9-241aabc61a39 with identifier: AP97194 to the API
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:39:33Z',
 'fuel_type': 'diesel',
 'id': '546ade60-09b8-52fc-aff9-241aabc61a39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP97194',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 77528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-13',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.3 JTD Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2011}
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP97194%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Saving data for AP97194: {'auction_closing_time': 1774715973.0, 'created_time': 1774514129.777852, 'last_price_update_time': 1774697860.358681}
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP97194') HTTP/1.1" 204 0
2026-03-28 11:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP87063%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Scrape type for TP87063: 0
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Scrape type for TX99790: 0
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Scrape type for BZ65544: 2
2026-03-28 11:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544
2026-03-28 11:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with scrape type 2
2026-03-28 11:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with scrape type 2
2026-03-28 11:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d, identifier: BZ65544
2026-03-28 11:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544
2026-03-28 11:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544
2026-03-28 11:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d with identifier: BZ65544 to the API
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-28T16:07:28Z',
 'fuel_type': 'petrol',
 'id': '16c74f63-e476-5cd6-bd53-6cd7ef8d9b9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ65544',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 78105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-11',
 'seller_name': None,
 'title': 'Ford Kuga 1.6 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Saving data for BZ65544: {'auction_closing_time': 1774714048.0, 'created_time': 1774514153.935643, 'last_price_update_time': 1774697860.929425}
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ65544') HTTP/1.1" 204 0
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL40552%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Scrape type for JL40552: 0
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB89489%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Scrape type for AB89489: 0
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF35218%27 HTTP/1.1" 200 None
2026-03-28 11:37:40 [auto1.be] INFO: Scrape type for AF35218: 0
2026-03-28 11:37:40 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG25655%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for WG25655: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT74022%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for XT74022: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for XE18058: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR44079%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for BR44079: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN27020%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for KN27020: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC35394%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for AC35394: 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for CD06973: 2
2026-03-28 11:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973
2026-03-28 11:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with scrape type 2
2026-03-28 11:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with scrape type 2
2026-03-28 11:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ed41241-6f2e-5505-acbb-f32d30ffeab7, identifier: CD06973
2026-03-28 11:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973
2026-03-28 11:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973
2026-03-28 11:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ed41241-6f2e-5505-acbb-f32d30ffeab7 with identifier: CD06973 to the API
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:42:15Z',
 'fuel_type': 'petrol',
 'id': '6ed41241-6f2e-5505-acbb-f32d30ffeab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD06973',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 188775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.0 Turbo Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2018}
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Saving data for CD06973: {'auction_closing_time': 1774716135.0, 'created_time': 1774514150.127178, 'last_price_update_time': 1774697861.532216}
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD06973') HTTP/1.1" 204 0
2026-03-28 11:37:41 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX10335%27 HTTP/1.1" 200 None
2026-03-28 11:37:41 [auto1.be] INFO: Scrape type for JX10335: 2
2026-03-28 11:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335
2026-03-28 11:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with scrape type 2
2026-03-28 11:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with scrape type 2
2026-03-28 11:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 584ef37c-4e9b-5736-a901-e1ef545bc1d3, identifier: JX10335
2026-03-28 11:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335
2026-03-28 11:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335
2026-03-28 11:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335 to the API
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:46:50Z',
 'fuel_type': 'diesel',
 'id': '584ef37c-4e9b-5736-a901-e1ef545bc1d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX10335',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 191035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2017}
2026-03-28 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX10335%27 HTTP/1.1" 200 None
2026-03-28 11:37:42 [auto1.be] INFO: Saving data for JX10335: {'auction_closing_time': 1774716410.0, 'created_time': 1773238231.767809, 'last_price_update_time': 1774697862.069052}
2026-03-28 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX10335') HTTP/1.1" 204 0
2026-03-28 11:37:42 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-28 11:37:42 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-28 11:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:42 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1821 | hits on page: 40
2026-03-28 11:37:42 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-28 11:37:43 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-28 11:37:43 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 11:37:43 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM70865%27 HTTP/1.1" 200 None
2026-03-28 11:37:43 [auto1.be] INFO: Scrape type for HM70865: 0
2026-03-28 11:37:43 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR60731%27 HTTP/1.1" 200 None
2026-03-28 11:37:43 [auto1.be] INFO: Scrape type for RR60731: 2
2026-03-28 11:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e56ca9ca-05d9-50ec-822e-438f28a13b67 with identifier: RR60731
2026-03-28 11:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56ca9ca-05d9-50ec-822e-438f28a13b67 with scrape type 2
2026-03-28 11:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e56ca9ca-05d9-50ec-822e-438f28a13b67 with scrape type 2
2026-03-28 11:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e56ca9ca-05d9-50ec-822e-438f28a13b67, identifier: RR60731
2026-03-28 11:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e56ca9ca-05d9-50ec-822e-438f28a13b67 with identifier: RR60731
2026-03-28 11:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e56ca9ca-05d9-50ec-822e-438f28a13b67 with identifier: RR60731
2026-03-28 11:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e56ca9ca-05d9-50ec-822e-438f28a13b67 with identifier: RR60731 to the API
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:05:32Z',
 'fuel_type': 'diesel',
 'id': 'e56ca9ca-05d9-50ec-822e-438f28a13b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR60731',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 274470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-22',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR60731%27 HTTP/1.1" 200 None
2026-03-28 11:37:43 [auto1.be] INFO: Saving data for RR60731: {'auction_closing_time': 1774713932.0, 'created_time': 1774514153.574866, 'last_price_update_time': 1774697863.450596}
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR60731') HTTP/1.1" 204 0
2026-03-28 11:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:43 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-28 11:37:43 [auto1.be] INFO: Scrape type for VW71513: 2
2026-03-28 11:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-28 11:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2953698-693a-5e57-87e1-b5a5fb178847 with scrape type 2
2026-03-28 11:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2953698-693a-5e57-87e1-b5a5fb178847 with scrape type 2
2026-03-28 11:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2953698-693a-5e57-87e1-b5a5fb178847, identifier: VW71513
2026-03-28 11:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-28 11:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-28 11:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513 to the API
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:04:42Z',
 'fuel_type': 'petrol',
 'id': 'e2953698-693a-5e57-87e1-b5a5fb178847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW71513',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 145941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'Audi A7 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-28 11:37:43 [auto1.be] INFO: Saving data for VW71513: {'auction_closing_time': 1774713882.0, 'created_time': 1773693872.113411, 'last_price_update_time': 1774697863.885784}
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW71513') HTTP/1.1" 204 0
2026-03-28 11:37:43 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-28 11:37:43 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-28 11:37:43 [auto1.be] INFO: Scrape type for HD23270: 2
2026-03-28 11:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270
2026-03-28 11:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9669648d-294f-5a82-937e-ec50254d4d0b with scrape type 2
2026-03-28 11:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9669648d-294f-5a82-937e-ec50254d4d0b with scrape type 2
2026-03-28 11:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9669648d-294f-5a82-937e-ec50254d4d0b, identifier: HD23270
2026-03-28 11:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270
2026-03-28 11:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270
2026-03-28 11:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9669648d-294f-5a82-937e-ec50254d4d0b with identifier: HD23270 to the API
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:52:40Z',
 'fuel_type': 'petrol',
 'id': '9669648d-294f-5a82-937e-ec50254d4d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD23270',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 107408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Saving data for HD23270: {'auction_closing_time': 1774716760.0, 'created_time': 1774514139.893756, 'last_price_update_time': 1774697864.300725}
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HD23270') HTTP/1.1" 204 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR16317%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for MR16317: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP38880%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for CP38880: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW93174%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for VW93174: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for SJ72272: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB89914%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for ZB89914: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC75548%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for ZC75548: 2
2026-03-28 11:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548
2026-03-28 11:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with scrape type 2
2026-03-28 11:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with scrape type 2
2026-03-28 11:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8969eab-8dc6-5b82-8445-d3e575ac6fa2, identifier: ZC75548
2026-03-28 11:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548
2026-03-28 11:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548
2026-03-28 11:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548 to the API
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:39:55Z',
 'fuel_type': 'petrol',
 'id': 'e8969eab-8dc6-5b82-8445-d3e575ac6fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC75548',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 71470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2017}
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC75548%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Saving data for ZC75548: {'auction_closing_time': 1774715995.0, 'created_time': 1774427752.383658, 'last_price_update_time': 1774697864.834889}
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC75548') HTTP/1.1" 204 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB02189%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for CB02189: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ85398%27 HTTP/1.1" 200 None
2026-03-28 11:37:44 [auto1.be] INFO: Scrape type for FJ85398: 0
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-28 11:37:44 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-28 11:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC39555%27 HTTP/1.1" 200 None
2026-03-28 11:37:45 [auto1.be] INFO: Scrape type for PC39555: 0
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-28 11:37:45 [auto1.be] INFO: Scrape type for GN71373: 0
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-28 11:37:45 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN84271%27 HTTP/1.1" 200 None
2026-03-28 11:37:45 [auto1.be] INFO: Scrape type for XN84271: 0
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-28 11:37:45 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-28 11:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:45 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1821 | hits on page: 40
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-28 11:37:45 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW03040%27 HTTP/1.1" 200 None
2026-03-28 11:37:46 [auto1.be] INFO: Scrape type for HW03040: 2
2026-03-28 11:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040
2026-03-28 11:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768ff7d3-76f0-5859-88cb-1f4834073b18 with scrape type 2
2026-03-28 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768ff7d3-76f0-5859-88cb-1f4834073b18 with scrape type 2
2026-03-28 11:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 768ff7d3-76f0-5859-88cb-1f4834073b18, identifier: HW03040
2026-03-28 11:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040
2026-03-28 11:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040
2026-03-28 11:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040 to the API
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:40:30Z',
 'fuel_type': 'diesel',
 'id': '768ff7d3-76f0-5859-88cb-1f4834073b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW03040',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 253404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW03040%27 HTTP/1.1" 200 None
2026-03-28 11:37:46 [auto1.be] INFO: Saving data for HW03040: {'auction_closing_time': 1774716030.0, 'created_time': 1773693916.614651, 'last_price_update_time': 1774697866.871622}
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW03040') HTTP/1.1" 204 0
2026-03-28 11:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:46 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-28 11:37:46 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-28 11:37:46 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-28 11:37:46 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-28 11:37:46 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH93162%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for YH93162: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB63888%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for FB63888: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for YW61664: 2
2026-03-28 11:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664
2026-03-28 11:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3128da6-d32b-5e75-9c67-d4977c4fbca4 with scrape type 2
2026-03-28 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3128da6-d32b-5e75-9c67-d4977c4fbca4 with scrape type 2
2026-03-28 11:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3128da6-d32b-5e75-9c67-d4977c4fbca4, identifier: YW61664
2026-03-28 11:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664
2026-03-28 11:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664
2026-03-28 11:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3128da6-d32b-5e75-9c67-d4977c4fbca4 with identifier: YW61664 to the API
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:59:28Z',
 'fuel_type': 'diesel',
 'id': 'e3128da6-d32b-5e75-9c67-d4977c4fbca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW61664',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Terrano',
 'odometer': 218638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-22',
 'seller_name': None,
 'title': 'Nissan Terrano 3.0 TD Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Saving data for YW61664: {'auction_closing_time': 1774717168.0, 'created_time': 1774125450.165764, 'last_price_update_time': 1774697867.42802}
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW61664') HTTP/1.1" 204 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE27589%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for HE27589: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA95611%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for MA95611: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC02969%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for TC02969: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN67239%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for YN67239: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW46644%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for RW46644: 0
2026-03-28 11:37:47 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-28 11:37:47 [auto1.be] INFO: Scrape type for BT09121: 2
2026-03-28 11:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121
2026-03-28 11:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8659b4a-f50a-5269-8889-c4611628566b with scrape type 2
2026-03-28 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8659b4a-f50a-5269-8889-c4611628566b with scrape type 2
2026-03-28 11:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8659b4a-f50a-5269-8889-c4611628566b, identifier: BT09121
2026-03-28 11:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121
2026-03-28 11:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121
2026-03-28 11:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8659b4a-f50a-5269-8889-c4611628566b with identifier: BT09121 to the API
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:58:39Z',
 'fuel_type': 'petrol',
 'id': 'd8659b4a-f50a-5269-8889-c4611628566b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT09121',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 71492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Black Shadow 4x2',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x2',
 'year': 2017}
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-28 11:37:48 [auto1.be] INFO: Saving data for BT09121: {'auction_closing_time': 1774717119.0, 'created_time': 1774514143.293789, 'last_price_update_time': 1774697868.016845}
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT09121') HTTP/1.1" 204 0
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-28 11:37:48 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-28 11:37:48 [auto1.be] INFO: Scrape type for CR21244: 2
2026-03-28 11:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244
2026-03-28 11:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with scrape type 2
2026-03-28 11:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with scrape type 2
2026-03-28 11:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a, identifier: CR21244
2026-03-28 11:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244
2026-03-28 11:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244
2026-03-28 11:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a with identifier: CR21244 to the API
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:11:32Z',
 'fuel_type': 'diesel',
 'id': 'e4d0c74d-c6ec-50e5-a8f9-98ec0d04c35a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR21244',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 123081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L3H2 Club Start&Stop',
 'transmission': 'manual',
 'trim': '33 L3H2 Club Start&Stop',
 'year': 2020}
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-28 11:37:48 [auto1.be] INFO: Saving data for CR21244: {'auction_closing_time': 1774714292.0, 'created_time': 1773384486.133218, 'last_price_update_time': 1774697868.53848}
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CR21244') HTTP/1.1" 204 0
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-28 11:37:48 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-28 11:37:48 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-28 11:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:37:49 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1821 | hits on page: 40
2026-03-28 11:37:49 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-28 11:37:49 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 11:37:49 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-28 11:37:49 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-28 11:37:49 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-28 11:37:49 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-28 11:37:49 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS55716%27 HTTP/1.1" 200 None
2026-03-28 11:37:49 [auto1.be] INFO: Scrape type for HS55716: 0
2026-03-28 11:37:49 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-28 11:37:49 [auto1.be] INFO: Scrape type for MJ01257: 2
2026-03-28 11:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257
2026-03-28 11:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8c8223-c2d0-5dae-af18-465feeec66c5 with scrape type 2
2026-03-28 11:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8c8223-c2d0-5dae-af18-465feeec66c5 with scrape type 2
2026-03-28 11:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac8c8223-c2d0-5dae-af18-465feeec66c5, identifier: MJ01257
2026-03-28 11:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257
2026-03-28 11:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257
2026-03-28 11:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257 to the API
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:43:26Z',
 'fuel_type': 'petrol',
 'id': 'ac8c8223-c2d0-5dae-af18-465feeec66c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ01257',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Townstar',
 'odometer': 41483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-06',
 'seller_name': None,
 'title': 'Nissan Townstar 1.3 DIG-T L1 Acenta',
 'transmission': 'manual',
 'trim': 'L1 Acenta',
 'year': 2023}
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-28 11:37:49 [auto1.be] INFO: Saving data for MJ01257: {'auction_closing_time': 1774716206.0, 'created_time': 1774514134.616338, 'last_price_update_time': 1774697869.959741}
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ01257') HTTP/1.1" 204 0
2026-03-28 11:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB82847%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for UB82847: 0
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR21590%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for HR21590: 0
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE31569%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for NE31569: 0
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF25932%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for TF25932: 0
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD17756%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for BD17756: 0
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for MB15455: 2
2026-03-28 11:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455
2026-03-28 11:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with scrape type 2
2026-03-28 11:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with scrape type 2
2026-03-28 11:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a6ef1ee9-4ded-577e-a398-c311dca1e5b9, identifier: MB15455
2026-03-28 11:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455
2026-03-28 11:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455
2026-03-28 11:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a6ef1ee9-4ded-577e-a398-c311dca1e5b9 with identifier: MB15455 to the API
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:31:49Z',
 'fuel_type': 'petrol',
 'id': 'a6ef1ee9-4ded-577e-a398-c311dca1e5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB15455',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 53885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-19',
 'seller_name': None,
 'title': 'Citroen C5 1.6 THP Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Saving data for MB15455: {'auction_closing_time': 1774715509.0, 'created_time': 1774125447.064316, 'last_price_update_time': 1774697870.539692}
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB15455') HTTP/1.1" 204 0
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-28 11:37:50 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT96819%27 HTTP/1.1" 200 None
2026-03-28 11:37:50 [auto1.be] INFO: Scrape type for WT96819: 2
2026-03-28 11:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819
2026-03-28 11:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62be18b7-9493-5c34-bef7-506b1a42f88b with scrape type 2
2026-03-28 11:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62be18b7-9493-5c34-bef7-506b1a42f88b with scrape type 2
2026-03-28 11:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 62be18b7-9493-5c34-bef7-506b1a42f88b, identifier: WT96819
2026-03-28 11:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819
2026-03-28 11:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819
2026-03-28 11:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819 to the API
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:57:50Z',
 'fuel_type': 'diesel',
 'id': '62be18b7-9493-5c34-bef7-506b1a42f88b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT96819',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 172852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 2,7t Authentique',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t Authentique',
 'year': 2013}
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT96819%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Saving data for WT96819: {'auction_closing_time': 1774717070.0, 'created_time': 1774427754.140828, 'last_price_update_time': 1774697871.091549}
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT96819') HTTP/1.1" 204 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE05105%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for GE05105: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM85548%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for XM85548: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH22912%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for LH22912: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP73132%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for EP73132: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for YN92139: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK21410%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for YK21410: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN48415%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for HN48415: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX75796%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for ZX75796: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN00182%27 HTTP/1.1" 200 None
2026-03-28 11:37:51 [auto1.be] INFO: Scrape type for WN00182: 0
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 11:37:51 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 11:38:06 [scrapy.extensions.logstats] INFO: Crawled 150 pages (at 15 pages/min), scraped 126 items (at 51 items/min)
2026-03-28 11:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:22 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:22 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-28 11:38:22 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-28 11:38:22 [auto1.be] INFO: Scrape type for RS16623: 2
2026-03-28 11:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-28 11:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15dabd15-1724-5fec-9932-b70f222b7e77 with scrape type 2
2026-03-28 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15dabd15-1724-5fec-9932-b70f222b7e77 with scrape type 2
2026-03-28 11:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15dabd15-1724-5fec-9932-b70f222b7e77, identifier: RS16623
2026-03-28 11:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-28 11:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-28 11:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623 to the API
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:46:00Z',
 'fuel_type': 'petrol',
 'id': '15dabd15-1724-5fec-9932-b70f222b7e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS16623',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 141191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Active",
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-28 11:38:22 [auto1.be] INFO: Saving data for RS16623: {'auction_closing_time': 1774716360.0, 'created_time': 1773135652.636807, 'last_price_update_time': 1774697902.761231}
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS16623') HTTP/1.1" 204 0
2026-03-28 11:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:22 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-28 11:38:22 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF21497%27 HTTP/1.1" 200 None
2026-03-28 11:38:22 [auto1.be] INFO: Scrape type for HF21497: 2
2026-03-28 11:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 854a2021-34aa-5807-8d7e-a1595100d1b8 with identifier: HF21497
2026-03-28 11:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 854a2021-34aa-5807-8d7e-a1595100d1b8 with scrape type 2
2026-03-28 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 854a2021-34aa-5807-8d7e-a1595100d1b8 with scrape type 2
2026-03-28 11:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 854a2021-34aa-5807-8d7e-a1595100d1b8, identifier: HF21497
2026-03-28 11:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 854a2021-34aa-5807-8d7e-a1595100d1b8 with identifier: HF21497
2026-03-28 11:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 854a2021-34aa-5807-8d7e-a1595100d1b8 with identifier: HF21497
2026-03-28 11:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 854a2021-34aa-5807-8d7e-a1595100d1b8 with identifier: HF21497 to the API
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:43Z',
 'fuel_type': 'petrol',
 'id': '854a2021-34aa-5807-8d7e-a1595100d1b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF21497',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 62921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-20',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2022}
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF21497%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Saving data for HF21497: {'auction_closing_time': 1774716343.0, 'created_time': 1773953276.076555, 'last_price_update_time': 1774697903.279251}
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HF21497') HTTP/1.1" 204 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK03982%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for CK03982: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15441%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for CH15441: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for HM28534: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN58260%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for YN58260: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC53588%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for ZC53588: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG60858%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for WG60858: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA07784%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for PA07784: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL24574%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for JL24574: 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for VU61418: 2
2026-03-28 11:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418
2026-03-28 11:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb52768-7a66-5781-8faa-9000dcb72b7d with scrape type 2
2026-03-28 11:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb52768-7a66-5781-8faa-9000dcb72b7d with scrape type 2
2026-03-28 11:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7cb52768-7a66-5781-8faa-9000dcb72b7d, identifier: VU61418
2026-03-28 11:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418
2026-03-28 11:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418
2026-03-28 11:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7cb52768-7a66-5781-8faa-9000dcb72b7d with identifier: VU61418 to the API
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:21Z',
 'fuel_type': 'diesel',
 'id': '7cb52768-7a66-5781-8faa-9000dcb72b7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU61418',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 189477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-09',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Saving data for VU61418: {'auction_closing_time': 1774716261.0, 'created_time': 1774514148.180901, 'last_price_update_time': 1774697903.871088}
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VU61418') HTTP/1.1" 204 0
2026-03-28 11:38:23 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB18331%27 HTTP/1.1" 200 None
2026-03-28 11:38:23 [auto1.be] INFO: Scrape type for GB18331: 2
2026-03-28 11:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5b536c-d57f-53d3-98f4-6fd2da631554 with identifier: GB18331
2026-03-28 11:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5b536c-d57f-53d3-98f4-6fd2da631554 with scrape type 2
2026-03-28 11:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5b536c-d57f-53d3-98f4-6fd2da631554 with scrape type 2
2026-03-28 11:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf5b536c-d57f-53d3-98f4-6fd2da631554, identifier: GB18331
2026-03-28 11:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf5b536c-d57f-53d3-98f4-6fd2da631554 with identifier: GB18331
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 11:38:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf5b536c-d57f-53d3-98f4-6fd2da631554 with identifier: GB18331
2026-03-28 11:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf5b536c-d57f-53d3-98f4-6fd2da631554 with identifier: GB18331 to the API
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:42Z',
 'fuel_type': 'gas',
 'id': 'cf5b536c-d57f-53d3-98f4-6fd2da631554',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB18331',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 152544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TGI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2020}
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB18331%27 HTTP/1.1" 200 None
2026-03-28 11:38:24 [auto1.be] INFO: Saving data for GB18331: {'auction_closing_time': 1774714782.0, 'created_time': 1774514137.692224, 'last_price_update_time': 1774697904.545343}
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB18331') HTTP/1.1" 204 0
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-28 11:38:24 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-28 11:38:24 [auto1.be] INFO: Scrape type for GP50240: 2
2026-03-28 11:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240
2026-03-28 11:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0087310-ce2f-5372-bd82-e93383830886 with scrape type 2
2026-03-28 11:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0087310-ce2f-5372-bd82-e93383830886 with scrape type 2
2026-03-28 11:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0087310-ce2f-5372-bd82-e93383830886, identifier: GP50240
2026-03-28 11:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240
2026-03-28 11:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240
2026-03-28 11:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0087310-ce2f-5372-bd82-e93383830886 with identifier: GP50240 to the API
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:19:17Z',
 'fuel_type': 'petrol',
 'id': 'e0087310-ce2f-5372-bd82-e93383830886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP50240',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 109178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-28 11:38:24 [auto1.be] INFO: Saving data for GP50240: {'auction_closing_time': 1774714757.0, 'created_time': 1773135498.259113, 'last_price_update_time': 1774697904.976031}
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GP50240') HTTP/1.1" 204 0
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-28 11:38:24 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-28 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE98600%27 HTTP/1.1" 200 None
2026-03-28 11:38:25 [auto1.be] INFO: Scrape type for GE98600: 0
2026-03-28 11:38:25 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-28 11:38:25 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-28 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM50519%27 HTTP/1.1" 200 None
2026-03-28 11:38:25 [auto1.be] INFO: Scrape type for UM50519: 0
2026-03-28 11:38:25 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 11:38:25 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-28 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:26 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for RR05667: 0
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for KZ95632: 0
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for TS78695: 0
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL98118%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for UL98118: 0
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for AY48728: 0
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW49487%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for KW49487: 2
2026-03-28 11:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487
2026-03-28 11:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd05363b-356e-5cd3-826c-4d278edb5e0c with scrape type 2
2026-03-28 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd05363b-356e-5cd3-826c-4d278edb5e0c with scrape type 2
2026-03-28 11:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd05363b-356e-5cd3-826c-4d278edb5e0c, identifier: KW49487
2026-03-28 11:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487
2026-03-28 11:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487
2026-03-28 11:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487 to the API
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:03:33Z',
 'fuel_type': 'diesel',
 'id': 'dd05363b-356e-5cd3-826c-4d278edb5e0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW49487',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 136810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L2 Trend',
 'transmission': 'manual',
 'trim': '350 L2 Trend',
 'year': 2018}
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW49487%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Saving data for KW49487: {'auction_closing_time': 1774713813.0, 'created_time': 1773230571.822832, 'last_price_update_time': 1774697906.585352}
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW49487') HTTP/1.1" 204 0
2026-03-28 11:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:26 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-28 11:38:26 [auto1.be] INFO: Scrape type for JC58807: 2
2026-03-28 11:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807
2026-03-28 11:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with scrape type 2
2026-03-28 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with scrape type 2
2026-03-28 11:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049, identifier: JC58807
2026-03-28 11:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807
2026-03-28 11:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807
2026-03-28 11:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807 to the API
2026-03-28 11:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:59Z',
 'fuel_type': 'diesel',
 'id': 'bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC58807',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 119830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2017}
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Saving data for JC58807: {'auction_closing_time': 1774716179.0, 'created_time': 1773132177.722838, 'last_price_update_time': 1774697907.206747}
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC58807') HTTP/1.1" 204 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for YU69949: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA01247%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for PA01247: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV96305%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for NV96305: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN32726%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for PN32726: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK27252%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for VK27252: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL06267%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for ZL06267: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP77494%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for HP77494: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for UR96395: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-28 11:38:27 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-28 11:38:27 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-28 11:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:28 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM10661%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for LM10661: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ73148%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for WJ73148: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for XN45926: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB59400%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for UB59400: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for FV38279: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY06710%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for EY06710: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX67951%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for RX67951: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM98751%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for ZM98751: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU29895%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for YU29895: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC47788%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for PC47788: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ17204%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for XJ17204: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX95723%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for JX95723: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP70611%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for JP70611: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20411%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for BY20411: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED46000%27 HTTP/1.1" 200 None
2026-03-28 11:38:28 [auto1.be] INFO: Scrape type for ED46000: 0
2026-03-28 11:38:28 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-28 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU65745%27 HTTP/1.1" 200 None
2026-03-28 11:38:29 [auto1.be] INFO: Scrape type for MU65745: 0
2026-03-28 11:38:29 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-28 11:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:30 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV66357%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for UV66357: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU96332%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for XU96332: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS41207%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for GS41207: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU53193%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for SU53193: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG72902%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for EG72902: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC45178%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for YC45178: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU26363%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for ZU26363: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ61910%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for ZJ61910: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH02429%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for PH02429: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK22486%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for RK22486: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP17871%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for SP17871: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-28 11:38:30 [auto1.be] INFO: Scrape type for LJ62513: 0
2026-03-28 11:38:30 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 11:38:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:31 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK56681%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for PK56681: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for VE25219: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW39031%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for BW39031: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for TC19196: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF15536%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for BF15536: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC04988%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for PC04988: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for BD95571: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY14348%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for HY14348: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU52750%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for UU52750: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE95300%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for GE95300: 0
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-28 11:38:31 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN79579%27 HTTP/1.1" 200 None
2026-03-28 11:38:31 [auto1.be] INFO: Scrape type for XN79579: 0
2026-03-28 11:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:32 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for RA52713: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP34819%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for TP34819: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV25434%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for MV25434: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ13946%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for XZ13946: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC83971%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for JC83971: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ63338%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for VJ63338: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for MX26890: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT11413%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for KT11413: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY09771%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for HY09771: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for ZX91910: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ75207%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for FJ75207: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL87249%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for EL87249: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-28 11:38:32 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 11:38:32 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS70966%27 HTTP/1.1" 200 None
2026-03-28 11:38:33 [auto1.be] INFO: Scrape type for VS70966: 0
2026-03-28 11:38:33 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-28 11:38:33 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-28 11:38:33 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-28 11:38:33 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-28 11:38:33 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-28 11:38:33 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-28 11:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:34 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR03762%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for LR03762: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH43502%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for HH43502: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE21828%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for CE21828: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR17508%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for JR17508: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for CK64923: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS34473%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for MS34473: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 11:38:34 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-28 11:38:34 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-28 11:38:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:35 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-28 11:38:35 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-28 11:38:35 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-28 11:38:35 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-28 11:38:35 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-28 11:38:35 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-28 11:38:35 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW24606%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for WW24606: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF96553%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for VF96553: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR55859%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for TR55859: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL68944%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for SL68944: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP59959%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for CP59959: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU40891%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for ZU40891: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM95515%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for PM95515: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 11:38:36 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-28 11:38:36 [auto1.be] INFO: Scrape type for YT15018: 0
2026-03-28 11:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:37 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA13965%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for MA13965: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL31605%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for XL31605: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM57328%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for AM57328: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV08195%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for FV08195: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW35881%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for PW35881: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG24921%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for ZG24921: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC38550%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for GC38550: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH87974%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for TH87974: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL16576%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for XL16576: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-28 11:38:37 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST31185%27 HTTP/1.1" 200 None
2026-03-28 11:38:37 [auto1.be] INFO: Scrape type for ST31185: 0
2026-03-28 11:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:38 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT92928%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for WT92928: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for XJ24324: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT14549%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for VT14549: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG79733%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for WG79733: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 11:38:38 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-28 11:38:38 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB76910%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for GB76910: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF72066%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for WF72066: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR14818%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for RR14818: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-28 11:38:39 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-28 11:38:39 [auto1.be] INFO: Scrape type for BB40778: 2
2026-03-28 11:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-28 11:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with scrape type 2
2026-03-28 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with scrape type 2
2026-03-28 11:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76258935-be0a-58f6-b7dd-814fc3f8f5d1, identifier: BB40778
2026-03-28 11:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-28 11:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-28 11:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778 to the API
2026-03-28 11:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:38:52Z',
 'fuel_type': 'petrol',
 'id': '76258935-be0a-58f6-b7dd-814fc3f8f5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB40778',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 174725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-28 11:38:41 [auto1.be] INFO: Saving data for BB40778: {'auction_closing_time': 1774715932.0, 'created_time': 1774611364.225911, 'last_price_update_time': 1774697921.31927}
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB40778') HTTP/1.1" 204 0
2026-03-28 11:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:41 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-28 11:38:41 [auto1.be] INFO: Scrape type for VM57702: 2
2026-03-28 11:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-28 11:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with scrape type 2
2026-03-28 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with scrape type 2
2026-03-28 11:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5, identifier: VM57702
2026-03-28 11:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-28 11:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-28 11:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702 to the API
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:37:19Z',
 'fuel_type': 'diesel',
 'id': '6380588a-75da-5a3b-8dbe-d2c83a6ea6b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM57702',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 289125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2018}
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-28 11:38:41 [auto1.be] INFO: Saving data for VM57702: {'auction_closing_time': 1774715839.0, 'created_time': 1774611320.76343, 'last_price_update_time': 1774697921.804942}
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM57702') HTTP/1.1" 204 0
2026-03-28 11:38:41 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-28 11:38:41 [auto1.be] INFO: Scrape type for YV36261: 2
2026-03-28 11:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-28 11:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bbead9-acb7-5c85-b22c-dbea4f404194 with scrape type 2
2026-03-28 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bbead9-acb7-5c85-b22c-dbea4f404194 with scrape type 2
2026-03-28 11:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2bbead9-acb7-5c85-b22c-dbea4f404194, identifier: YV36261
2026-03-28 11:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-28 11:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-28 11:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261 to the API
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:42:41Z',
 'fuel_type': 'petrol',
 'id': 'b2bbead9-acb7-5c85-b22c-dbea4f404194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV36261',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 195767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2013}
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-28 11:38:42 [auto1.be] INFO: Saving data for YV36261: {'auction_closing_time': 1774716161.0, 'created_time': 1773866134.068108, 'last_price_update_time': 1774697922.174684}
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV36261') HTTP/1.1" 204 0
2026-03-28 11:38:42 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-28 11:38:42 [auto1.be] INFO: Scrape type for WG23357: 2
2026-03-28 11:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-28 11:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c06598ae-29da-5344-879a-d1331dcc094f with scrape type 2
2026-03-28 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c06598ae-29da-5344-879a-d1331dcc094f with scrape type 2
2026-03-28 11:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c06598ae-29da-5344-879a-d1331dcc094f, identifier: WG23357
2026-03-28 11:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-28 11:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-28 11:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357 to the API
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:55:26Z',
 'fuel_type': 'petrol',
 'id': 'c06598ae-29da-5344-879a-d1331dcc094f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG23357',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 11155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-17',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 Mild-Hybrid Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-28 11:38:42 [auto1.be] INFO: Saving data for WG23357: {'auction_closing_time': 1774716926.0, 'created_time': 1774611323.485967, 'last_price_update_time': 1774697922.550889}
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG23357') HTTP/1.1" 204 0
2026-03-28 11:38:42 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC34183%27 HTTP/1.1" 200 None
2026-03-28 11:38:42 [auto1.be] INFO: Scrape type for RC34183: 2
2026-03-28 11:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183
2026-03-28 11:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525abdd4-961e-585d-88ae-5b1e31f41e1b with scrape type 2
2026-03-28 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 525abdd4-961e-585d-88ae-5b1e31f41e1b with scrape type 2
2026-03-28 11:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 525abdd4-961e-585d-88ae-5b1e31f41e1b, identifier: RC34183
2026-03-28 11:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183
2026-03-28 11:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183
2026-03-28 11:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183 to the API
2026-03-28 11:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:46:34Z',
 'fuel_type': 'diesel',
 'id': '525abdd4-961e-585d-88ae-5b1e31f41e1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC34183',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 182991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-06',
 'seller_name': None,
 'title': 'Ford Fusion 1.6 TDCi Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2007}
2026-03-28 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC34183%27 HTTP/1.1" 200 None
2026-03-28 11:38:43 [auto1.be] INFO: Saving data for RC34183: {'auction_closing_time': 1774716394.0, 'created_time': 1774611332.110022, 'last_price_update_time': 1774697923.835342}
2026-03-28 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC34183') HTTP/1.1" 204 0
2026-03-28 11:38:43 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-28 11:38:43 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-28 11:38:43 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-28 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ41655%27 HTTP/1.1" 200 None
2026-03-28 11:38:43 [auto1.be] INFO: Scrape type for VZ41655: 2
2026-03-28 11:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655
2026-03-28 11:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with scrape type 2
2026-03-28 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with scrape type 2
2026-03-28 11:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88, identifier: VZ41655
2026-03-28 11:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655
2026-03-28 11:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655
2026-03-28 11:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655 to the API
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:46:34Z',
 'fuel_type': 'diesel',
 'id': 'b1683fd9-35d8-5d85-ba84-fd0a31fa4a88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ41655',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 181878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-08',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ41655%27 HTTP/1.1" 200 None
2026-03-28 11:38:44 [auto1.be] INFO: Saving data for VZ41655: {'auction_closing_time': 1774716394.0, 'created_time': 1774611340.86366, 'last_price_update_time': 1774697924.231088}
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ41655') HTTP/1.1" 204 0
2026-03-28 11:38:44 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-28 11:38:44 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 11:38:44 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 11:38:44 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 11:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:44 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:44 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-28 11:38:44 [auto1.be] INFO: Scrape type for NM33768: 2
2026-03-28 11:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-28 11:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78516ba2-6b22-5a5b-a721-9293f0a07342 with scrape type 2
2026-03-28 11:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78516ba2-6b22-5a5b-a721-9293f0a07342 with scrape type 2
2026-03-28 11:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78516ba2-6b22-5a5b-a721-9293f0a07342, identifier: NM33768
2026-03-28 11:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-28 11:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-28 11:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768 to the API
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:24Z',
 'fuel_type': 'diesel',
 'id': '78516ba2-6b22-5a5b-a721-9293f0a07342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM33768',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 157935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 dCi Acenta 4x4',
 'transmission': 'automatic',
 'trim': 'Acenta 4x4',
 'year': 2012}
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-28 11:38:45 [auto1.be] INFO: Saving data for NM33768: {'auction_closing_time': 1774714284.0, 'created_time': 1774611325.015862, 'last_price_update_time': 1774697925.826729}
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM33768') HTTP/1.1" 204 0
2026-03-28 11:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:45 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10971%27 HTTP/1.1" 200 None
2026-03-28 11:38:45 [auto1.be] INFO: Scrape type for TY10971: 2
2026-03-28 11:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971
2026-03-28 11:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with scrape type 2
2026-03-28 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with scrape type 2
2026-03-28 11:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a682c635-bc6f-5ecb-a0f9-9944bcb943b6, identifier: TY10971
2026-03-28 11:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971
2026-03-28 11:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971
2026-03-28 11:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971 to the API
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:32:09Z',
 'fuel_type': 'hybrid',
 'id': 'a682c635-bc6f-5ecb-a0f9-9944bcb943b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY10971',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 191792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-09',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four Business Line',
 'transmission': 'automatic',
 'trim': 'E-Four Business Line',
 'year': 2017}
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10971%27 HTTP/1.1" 200 None
2026-03-28 11:38:46 [auto1.be] INFO: Saving data for TY10971: {'auction_closing_time': 1774715529.0, 'created_time': 1774611351.616739, 'last_price_update_time': 1774697926.304895}
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY10971') HTTP/1.1" 204 0
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-28 11:38:46 [auto1.be] INFO: Scrape type for BU27000: 2
2026-03-28 11:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-28 11:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25410665-1619-5ac3-bdfa-bb2c02232e4b with scrape type 2
2026-03-28 11:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25410665-1619-5ac3-bdfa-bb2c02232e4b with scrape type 2
2026-03-28 11:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25410665-1619-5ac3-bdfa-bb2c02232e4b, identifier: BU27000
2026-03-28 11:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-28 11:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-28 11:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000 to the API
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:47:23Z',
 'fuel_type': 'petrol',
 'id': '25410665-1619-5ac3-bdfa-bb2c02232e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU27000',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 111130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Opel Combo Life 1.2 Turbo Advance XL',
 'transmission': 'automatic',
 'trim': 'Advance XL',
 'year': 2020}
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-28 11:38:46 [auto1.be] INFO: Saving data for BU27000: {'auction_closing_time': 1774716443.0, 'created_time': 1774611336.608016, 'last_price_update_time': 1774697926.755712}
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU27000') HTTP/1.1" 204 0
2026-03-28 11:38:46 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-28 11:38:46 [auto1.be] INFO: Scrape type for MP28046: 2
2026-03-28 11:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-28 11:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with scrape type 2
2026-03-28 11:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with scrape type 2
2026-03-28 11:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7, identifier: MP28046
2026-03-28 11:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-28 11:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-28 11:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046 to the API
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:34:20Z',
 'fuel_type': 'petrol',
 'id': '0eaaa256-18a7-52b9-ac7a-89014d3a4cb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP28046',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 76109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'automatic',
 'trim': 'Satellite',
 'year': 2011}
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-28 11:38:47 [auto1.be] INFO: Saving data for MP28046: {'auction_closing_time': 1774715660.0, 'created_time': 1774611363.885903, 'last_price_update_time': 1774697927.460699}
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MP28046') HTTP/1.1" 204 0
2026-03-28 11:38:47 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-28 11:38:47 [auto1.be] INFO: Scrape type for SL51907: 2
2026-03-28 11:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-28 11:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 094d12aa-415e-5ad0-b27b-d52674877643 with scrape type 2
2026-03-28 11:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 094d12aa-415e-5ad0-b27b-d52674877643 with scrape type 2
2026-03-28 11:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 094d12aa-415e-5ad0-b27b-d52674877643, identifier: SL51907
2026-03-28 11:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-28 11:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-28 11:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907 to the API
2026-03-28 11:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:09:16Z',
 'fuel_type': 'diesel',
 'id': '094d12aa-415e-5ad0-b27b-d52674877643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL51907',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 202104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-28 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-28 11:38:48 [auto1.be] INFO: Saving data for SL51907: {'auction_closing_time': 1774714156.0, 'created_time': 1773866476.957817, 'last_price_update_time': 1774697928.871004}
2026-03-28 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL51907') HTTP/1.1" 204 0
2026-03-28 11:38:48 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-28 11:38:48 [auto1.be] INFO: Scrape type for LE04651: 2
2026-03-28 11:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-28 11:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with scrape type 2
2026-03-28 11:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with scrape type 2
2026-03-28 11:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69, identifier: LE04651
2026-03-28 11:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-28 11:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-28 11:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651 to the API
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:57Z',
 'fuel_type': 'diesel',
 'id': 'b9fc4628-ca6c-5c67-ae80-c006e9f1dc69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE04651',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 47608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-25',
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 JTD SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2016}
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-28 11:38:49 [auto1.be] INFO: Saving data for LE04651: {'auction_closing_time': 1774715337.0, 'created_time': 1774611327.2566, 'last_price_update_time': 1774697929.265143}
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE04651') HTTP/1.1" 204 0
2026-03-28 11:38:49 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-28 11:38:49 [auto1.be] INFO: Scrape type for DL37030: 2
2026-03-28 11:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030
2026-03-28 11:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35de0836-6b7d-5752-ae3e-84f777b803c9 with scrape type 2
2026-03-28 11:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35de0836-6b7d-5752-ae3e-84f777b803c9 with scrape type 2
2026-03-28 11:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35de0836-6b7d-5752-ae3e-84f777b803c9, identifier: DL37030
2026-03-28 11:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030
2026-03-28 11:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030
2026-03-28 11:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030 to the API
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:50:43Z',
 'fuel_type': 'petrol',
 'id': '35de0836-6b7d-5752-ae3e-84f777b803c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL37030',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 10976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-28 11:38:49 [auto1.be] INFO: Saving data for DL37030: {'auction_closing_time': 1774716643.0, 'created_time': 1773909326.149795, 'last_price_update_time': 1774697929.660506}
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL37030') HTTP/1.1" 204 0
2026-03-28 11:38:49 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-28 11:38:49 [auto1.be] INFO: Scrape type for ZL15279: 2
2026-03-28 11:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-28 11:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with scrape type 2
2026-03-28 11:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with scrape type 2
2026-03-28 11:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d, identifier: ZL15279
2026-03-28 11:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-28 11:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-28 11:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279 to the API
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:49:06Z',
 'fuel_type': 'diesel',
 'id': 'ab0c8d4c-afc1-593f-bba2-4af7d0e2812d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15279',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 242853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-28 11:38:50 [auto1.be] INFO: Saving data for ZL15279: {'auction_closing_time': 1774716546.0, 'created_time': 1773909333.908026, 'last_price_update_time': 1774697930.057759}
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL15279') HTTP/1.1" 204 0
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-28 11:38:50 [auto1.be] INFO: Scrape type for NB03494: 2
2026-03-28 11:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-28 11:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab4edf-e363-585d-904a-7f498841c1d9 with scrape type 2
2026-03-28 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab4edf-e363-585d-904a-7f498841c1d9 with scrape type 2
2026-03-28 11:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0ab4edf-e363-585d-904a-7f498841c1d9, identifier: NB03494
2026-03-28 11:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-28 11:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-28 11:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494 to the API
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:56:06Z',
 'fuel_type': 'petrol',
 'id': 'c0ab4edf-e363-585d-904a-7f498841c1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB03494',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 40166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2022}
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-28 11:38:50 [auto1.be] INFO: Saving data for NB03494: {'auction_closing_time': 1774716966.0, 'created_time': 1773693675.093387, 'last_price_update_time': 1774697930.431556}
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB03494') HTTP/1.1" 204 0
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-28 11:38:50 [auto1.be] INFO: Scrape type for TS47815: 2
2026-03-28 11:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-28 11:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e7e6f1-e9bb-51de-89e5-d708d248f363 with scrape type 2
2026-03-28 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e7e6f1-e9bb-51de-89e5-d708d248f363 with scrape type 2
2026-03-28 11:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9e7e6f1-e9bb-51de-89e5-d708d248f363, identifier: TS47815
2026-03-28 11:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-28 11:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-28 11:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815 to the API
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:28:33Z',
 'fuel_type': 'diesel',
 'id': 'e9e7e6f1-e9bb-51de-89e5-d708d248f363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS47815',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 167217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-16',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD 70 Multijet Active',
 'transmission': 'manual',
 'trim': '70 Multijet Active',
 'year': 2004}
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-28 11:38:50 [auto1.be] INFO: Saving data for TS47815: {'auction_closing_time': 1774715313.0, 'created_time': 1774611325.841954, 'last_price_update_time': 1774697930.808575}
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS47815') HTTP/1.1" 204 0
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 11:38:50 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-28 11:38:50 [auto1.be] INFO: Scrape type for DE21401: 2
2026-03-28 11:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-28 11:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e211255-7efb-55df-a7e6-91faa685c42c with scrape type 2
2026-03-28 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e211255-7efb-55df-a7e6-91faa685c42c with scrape type 2
2026-03-28 11:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e211255-7efb-55df-a7e6-91faa685c42c, identifier: DE21401
2026-03-28 11:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-28 11:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-28 11:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401 to the API
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:27:08Z',
 'fuel_type': 'petrol',
 'id': '3e211255-7efb-55df-a7e6-91faa685c42c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE21401',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 38598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-28 11:38:51 [auto1.be] INFO: Saving data for DE21401: {'auction_closing_time': 1774715228.0, 'created_time': 1774611338.263394, 'last_price_update_time': 1774697931.217116}
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE21401') HTTP/1.1" 204 0
2026-03-28 11:38:51 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-28 11:38:51 [auto1.be] INFO: Scrape type for YH09444: 2
2026-03-28 11:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-28 11:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4abc93d3-0227-5f90-a27b-4ec27ca62880 with scrape type 2
2026-03-28 11:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4abc93d3-0227-5f90-a27b-4ec27ca62880 with scrape type 2
2026-03-28 11:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4abc93d3-0227-5f90-a27b-4ec27ca62880, identifier: YH09444
2026-03-28 11:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-28 11:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-28 11:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444 to the API
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:49Z',
 'fuel_type': 'diesel',
 'id': '4abc93d3-0227-5f90-a27b-4ec27ca62880',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH09444',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 97492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-24',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-28 11:38:51 [auto1.be] INFO: Saving data for YH09444: {'auction_closing_time': 1774714909.0, 'created_time': 1774611328.574673, 'last_price_update_time': 1774697931.697774}
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH09444') HTTP/1.1" 204 0
2026-03-28 11:38:51 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 11:38:51 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 11:38:51 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU79691%27 HTTP/1.1" 200 None
2026-03-28 11:38:51 [auto1.be] INFO: Scrape type for BU79691: 2
2026-03-28 11:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691
2026-03-28 11:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with scrape type 2
2026-03-28 11:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with scrape type 2
2026-03-28 11:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6, identifier: BU79691
2026-03-28 11:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691
2026-03-28 11:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691
2026-03-28 11:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691 to the API
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:40:57Z',
 'fuel_type': 'petrol',
 'id': 'a47dfb16-f2aa-5412-8073-6aca1f2d5ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU79691',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 118599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-10',
 'seller_name': None,
 'title': 'Renault Clio 1.2 IMusic Pack Dynamique',
 'transmission': 'manual',
 'trim': 'IMusic Pack Dynamique',
 'year': 2011}
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU79691%27 HTTP/1.1" 200 None
2026-03-28 11:38:52 [auto1.be] INFO: Saving data for BU79691: {'auction_closing_time': 1774716057.0, 'created_time': 1774611363.118275, 'last_price_update_time': 1774697932.067285}
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU79691') HTTP/1.1" 204 0
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-28 11:38:52 [auto1.be] INFO: Scrape type for CP42003: 2
2026-03-28 11:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-28 11:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b225942-8429-5d44-a314-122de3d7692b with scrape type 2
2026-03-28 11:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b225942-8429-5d44-a314-122de3d7692b with scrape type 2
2026-03-28 11:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b225942-8429-5d44-a314-122de3d7692b, identifier: CP42003
2026-03-28 11:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-28 11:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-28 11:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003 to the API
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:23:15Z',
 'fuel_type': 'petrol',
 'id': '6b225942-8429-5d44-a314-122de3d7692b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP42003',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 208306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2018}
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-28 11:38:52 [auto1.be] INFO: Saving data for CP42003: {'auction_closing_time': 1774714995.0, 'created_time': 1773224388.316616, 'last_price_update_time': 1774697932.557081}
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP42003') HTTP/1.1" 204 0
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-28 11:38:52 [auto1.be] INFO: Scrape type for LY80968: 2
2026-03-28 11:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-28 11:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with scrape type 2
2026-03-28 11:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with scrape type 2
2026-03-28 11:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea6776dc-8dfa-5974-bfab-c120f1cc51b9, identifier: LY80968
2026-03-28 11:38:52 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-28 11:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-28 11:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968 to the API
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:35Z',
 'fuel_type': 'petrol',
 'id': 'ea6776dc-8dfa-5974-bfab-c120f1cc51b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY80968',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 57491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-28 11:38:52 [auto1.be] INFO: Saving data for LY80968: {'auction_closing_time': 1774714715.0, 'created_time': 1773477347.71579, 'last_price_update_time': 1774697932.949917}
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY80968') HTTP/1.1" 204 0
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 11:38:52 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-28 11:38:52 [auto1.be] INFO: Scrape type for WP77061: 2
2026-03-28 11:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-28 11:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a147e50-aa18-5959-b2b8-28fea0ad92ba with scrape type 2
2026-03-28 11:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a147e50-aa18-5959-b2b8-28fea0ad92ba with scrape type 2
2026-03-28 11:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a147e50-aa18-5959-b2b8-28fea0ad92ba, identifier: WP77061
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-28 11:38:53 [auto1.be] INFO: Scrape type for JM34078: 2
2026-03-28 11:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-28 11:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89490faf-3f29-50b7-b5e6-da3866bc8354 with scrape type 2
2026-03-28 11:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89490faf-3f29-50b7-b5e6-da3866bc8354 with scrape type 2
2026-03-28 11:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89490faf-3f29-50b7-b5e6-da3866bc8354, identifier: JM34078
2026-03-28 11:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-28 11:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-28 11:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061 to the API
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-28T16:42:03Z',
 'fuel_type': 'petrol',
 'id': '8a147e50-aa18-5959-b2b8-28fea0ad92ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP77061',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 108707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seller_name': None,
 'title': 'Maserati Levante 2.0 Turbo Mild-Hybrid GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-28 11:38:53 [auto1.be] INFO: Saving data for WP77061: {'auction_closing_time': 1774716123.0, 'created_time': 1773747445.557384, 'last_price_update_time': 1774697933.438537}
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP77061') HTTP/1.1" 204 0
2026-03-28 11:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-28 11:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-28 11:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078 to the API
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:07:17Z',
 'fuel_type': 'diesel',
 'id': '89490faf-3f29-50b7-b5e6-da3866bc8354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM34078',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 198206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-21',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L2H1 3,0t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 3,0t',
 'year': 2018}
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-28 11:38:53 [auto1.be] INFO: Saving data for JM34078: {'auction_closing_time': 1774714037.0, 'created_time': 1774611362.735349, 'last_price_update_time': 1774697933.780309}
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM34078') HTTP/1.1" 204 0
2026-03-28 11:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-28 11:38:53 [auto1.be] INFO: Scrape type for TU68669: 2
2026-03-28 11:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-28 11:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264d6f6f-4cd5-516c-b999-a468d4bea33b with scrape type 2
2026-03-28 11:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 264d6f6f-4cd5-516c-b999-a468d4bea33b with scrape type 2
2026-03-28 11:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 264d6f6f-4cd5-516c-b999-a468d4bea33b, identifier: TU68669
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 11:38:53 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-28 11:38:53 [auto1.be] INFO: Scrape type for RK79502: 2
2026-03-28 11:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-28 11:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0d9d002-654d-51b1-a14f-04cb76d69395 with scrape type 2
2026-03-28 11:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0d9d002-654d-51b1-a14f-04cb76d69395 with scrape type 2
2026-03-28 11:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0d9d002-654d-51b1-a14f-04cb76d69395, identifier: RK79502
2026-03-28 11:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-28 11:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-28 11:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669 to the API
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:26Z',
 'fuel_type': 'diesel',
 'id': '264d6f6f-4cd5-516c-b999-a468d4bea33b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU68669',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 157938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-17',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction ultra',
 'transmission': 'manual',
 'trim': 'Attraction ultra',
 'year': 2015}
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-28 11:38:54 [auto1.be] INFO: Saving data for TU68669: {'auction_closing_time': 1774716206.0, 'created_time': 1774611375.0683, 'last_price_update_time': 1774697934.280729}
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU68669') HTTP/1.1" 204 0
2026-03-28 11:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-28 11:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-28 11:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502 to the API
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:57:19Z',
 'fuel_type': 'petrol',
 'id': 'a0d9d002-654d-51b1-a14f-04cb76d69395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK79502',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 60315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-28 11:38:54 [auto1.be] INFO: Saving data for RK79502: {'auction_closing_time': 1774717039.0, 'created_time': 1774611389.445167, 'last_price_update_time': 1774697934.65072}
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK79502') HTTP/1.1" 204 0
2026-03-28 11:38:54 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-28 11:38:54 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-28 11:38:54 [auto1.be] INFO: Scrape type for EN18719: 2
2026-03-28 11:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-28 11:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb3bb49-6bda-583f-99a8-71d676921b5f with scrape type 2
2026-03-28 11:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cb3bb49-6bda-583f-99a8-71d676921b5f with scrape type 2
2026-03-28 11:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cb3bb49-6bda-583f-99a8-71d676921b5f, identifier: EN18719
2026-03-28 11:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-28 11:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-28 11:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719 to the API
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:46:24Z',
 'fuel_type': 'petrol',
 'id': '8cb3bb49-6bda-583f-99a8-71d676921b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN18719',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 108145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-28 11:38:55 [auto1.be] INFO: Saving data for EN18719: {'auction_closing_time': 1774716384.0, 'created_time': 1774611353.281007, 'last_price_update_time': 1774697935.032627}
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN18719') HTTP/1.1" 204 0
2026-03-28 11:38:55 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 11:38:55 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-28 11:38:55 [auto1.be] INFO: Scrape type for NP69529: 2
2026-03-28 11:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-28 11:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf917ded-7fe1-56cc-af78-e63f7a25bf1a with scrape type 2
2026-03-28 11:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf917ded-7fe1-56cc-af78-e63f7a25bf1a with scrape type 2
2026-03-28 11:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf917ded-7fe1-56cc-af78-e63f7a25bf1a, identifier: NP69529
2026-03-28 11:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-28 11:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-28 11:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529 to the API
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:16:13Z',
 'fuel_type': 'petrol',
 'id': 'cf917ded-7fe1-56cc-af78-e63f7a25bf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP69529',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 155186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-01',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-28 11:38:55 [auto1.be] INFO: Saving data for NP69529: {'auction_closing_time': 1774714573.0, 'created_time': 1774611354.839513, 'last_price_update_time': 1774697935.448878}
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP69529') HTTP/1.1" 204 0
2026-03-28 11:38:55 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 11:38:55 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-28 11:38:55 [auto1.be] INFO: Scrape type for GH45635: 2
2026-03-28 11:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-28 11:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with scrape type 2
2026-03-28 11:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with scrape type 2
2026-03-28 11:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37, identifier: GH45635
2026-03-28 11:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-28 11:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-28 11:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635 to the API
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-28T16:09:51Z',
 'fuel_type': 'hybrid',
 'id': '23257b69-fb1f-5cc3-8d02-79f3bcb2fc37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH45635',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 206000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2021}
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-28 11:38:55 [auto1.be] INFO: Saving data for GH45635: {'auction_closing_time': 1774714191.0, 'created_time': 1773301934.312303, 'last_price_update_time': 1774697935.828116}
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH45635') HTTP/1.1" 204 0
2026-03-28 11:38:55 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 11:38:55 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-28 11:38:55 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-28 11:38:55 [auto1.be] INFO: Scrape type for ZR45530: 2
2026-03-28 11:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-28 11:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with scrape type 2
2026-03-28 11:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with scrape type 2
2026-03-28 11:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58be042d-1b7e-5467-b6e9-ade87f6ccce1, identifier: ZR45530
2026-03-28 11:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-28 11:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-28 11:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530 to the API
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:24:15Z',
 'fuel_type': 'diesel',
 'id': '58be042d-1b7e-5467-b6e9-ade87f6ccce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR45530',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 223109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueTDI',
 'transmission': 'manual',
 'trim': 'Comfortline BlueTDI',
 'year': 2013}
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-28 11:38:56 [auto1.be] INFO: Saving data for ZR45530: {'auction_closing_time': 1774715055.0, 'created_time': 1774611360.700796, 'last_price_update_time': 1774697936.216685}
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR45530') HTTP/1.1" 204 0
2026-03-28 11:38:56 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 11:38:56 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 11:38:56 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-28 11:38:56 [auto1.be] INFO: Scrape type for LX45606: 2
2026-03-28 11:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-28 11:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb4a1a1-2934-5c80-a519-2323b635ccf3 with scrape type 2
2026-03-28 11:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfb4a1a1-2934-5c80-a519-2323b635ccf3 with scrape type 2
2026-03-28 11:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bfb4a1a1-2934-5c80-a519-2323b635ccf3, identifier: LX45606
2026-03-28 11:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-28 11:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-28 11:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606 to the API
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:27:11Z',
 'fuel_type': 'diesel',
 'id': 'bfb4a1a1-2934-5c80-a519-2323b635ccf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX45606',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Rodius',
 'odometer': 276844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': None,
 'title': 'Ssangyong Rodius 2.2 TD Sapphire 4WD',
 'transmission': 'automatic',
 'trim': 'Sapphire 4WD',
 'year': 2018}
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-28 11:38:56 [auto1.be] INFO: Saving data for LX45606: {'auction_closing_time': 1774715231.0, 'created_time': 1774611354.488798, 'last_price_update_time': 1774697936.609246}
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LX45606') HTTP/1.1" 204 0
2026-03-28 11:38:56 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-28 11:38:56 [auto1.be] INFO: Scrape type for LC46636: 2
2026-03-28 11:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-28 11:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254735c0-f192-5a60-ba4c-80af7ce6e950 with scrape type 2
2026-03-28 11:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 254735c0-f192-5a60-ba4c-80af7ce6e950 with scrape type 2
2026-03-28 11:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 254735c0-f192-5a60-ba4c-80af7ce6e950, identifier: LC46636
2026-03-28 11:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-28 11:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-28 11:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636 to the API
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:05:50Z',
 'fuel_type': 'petrol',
 'id': '254735c0-f192-5a60-ba4c-80af7ce6e950',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC46636',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 97233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-04',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-28 11:38:57 [auto1.be] INFO: Saving data for LC46636: {'auction_closing_time': 1774713950.0, 'created_time': 1774611390.43872, 'last_price_update_time': 1774697937.082097}
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LC46636') HTTP/1.1" 204 0
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-28 11:38:57 [auto1.be] INFO: Scrape type for AS01915: 2
2026-03-28 11:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-28 11:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c40a051-92bd-537a-9140-d36f2ea9d85f with scrape type 2
2026-03-28 11:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c40a051-92bd-537a-9140-d36f2ea9d85f with scrape type 2
2026-03-28 11:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c40a051-92bd-537a-9140-d36f2ea9d85f, identifier: AS01915
2026-03-28 11:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-28 11:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-28 11:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915 to the API
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:45:33Z',
 'fuel_type': 'petrol',
 'id': '9c40a051-92bd-537a-9140-d36f2ea9d85f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS01915',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 93339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-09',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-28 11:38:57 [auto1.be] INFO: Saving data for AS01915: {'auction_closing_time': 1774716333.0, 'created_time': 1773650189.72292, 'last_price_update_time': 1774697937.488167}
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AS01915') HTTP/1.1" 204 0
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-28 11:38:57 [auto1.be] INFO: Scrape type for RA65802: 2
2026-03-28 11:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-28 11:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd6db043-d074-5a67-b1c0-b31b974993e8 with scrape type 2
2026-03-28 11:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd6db043-d074-5a67-b1c0-b31b974993e8 with scrape type 2
2026-03-28 11:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd6db043-d074-5a67-b1c0-b31b974993e8, identifier: RA65802
2026-03-28 11:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-28 11:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-28 11:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802 to the API
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:14:15Z',
 'fuel_type': 'diesel',
 'id': 'cd6db043-d074-5a67-b1c0-b31b974993e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA65802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 193714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2019}
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-28 11:38:57 [auto1.be] INFO: Saving data for RA65802: {'auction_closing_time': 1774714455.0, 'created_time': 1773223878.480023, 'last_price_update_time': 1774697937.917164}
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA65802') HTTP/1.1" 204 0
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-28 11:38:57 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1821 | hits on page: 40
2026-03-28 11:38:57 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-28 11:38:57 [auto1.be] INFO: Scrape type for FR21473: 2
2026-03-28 11:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-28 11:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with scrape type 2
2026-03-28 11:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with scrape type 2
2026-03-28 11:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1, identifier: FR21473
2026-03-28 11:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-28 11:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-28 11:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473 to the API
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:25:28Z',
 'fuel_type': 'diesel',
 'id': 'd8c3eb4d-4d2b-59c5-aa67-3665c4f93af1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR21473',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 146761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-28 11:38:58 [auto1.be] INFO: Saving data for FR21473: {'auction_closing_time': 1774715128.0, 'created_time': 1773909349.938396, 'last_price_update_time': 1774697938.325668}
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR21473') HTTP/1.1" 204 0
2026-03-28 11:38:58 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-28 11:38:58 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL14568%27 HTTP/1.1" 200 None
2026-03-28 11:38:58 [auto1.be] INFO: Scrape type for HL14568: 2
2026-03-28 11:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568
2026-03-28 11:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf025943-3ebe-55fe-af13-57de399c86c3 with scrape type 2
2026-03-28 11:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf025943-3ebe-55fe-af13-57de399c86c3 with scrape type 2
2026-03-28 11:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf025943-3ebe-55fe-af13-57de399c86c3, identifier: HL14568
2026-03-28 11:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568
2026-03-28 11:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568
2026-03-28 11:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568 to the API
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:38:22Z',
 'fuel_type': 'diesel',
 'id': 'cf025943-3ebe-55fe-af13-57de399c86c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL14568',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 240071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL14568%27 HTTP/1.1" 200 None
2026-03-28 11:38:58 [auto1.be] INFO: Saving data for HL14568: {'auction_closing_time': 1774715902.0, 'created_time': 1774611371.357133, 'last_price_update_time': 1774697938.787477}
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL14568') HTTP/1.1" 204 0
2026-03-28 11:38:58 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 11:38:58 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-28 11:38:58 [auto1.be] INFO: Scrape type for BR84638: 2
2026-03-28 11:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-28 11:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321116eb-2129-57ae-b68c-a7e210c6064e with scrape type 2
2026-03-28 11:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 321116eb-2129-57ae-b68c-a7e210c6064e with scrape type 2
2026-03-28 11:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 321116eb-2129-57ae-b68c-a7e210c6064e, identifier: BR84638
2026-03-28 11:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-28 11:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-28 11:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638 to the API
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:15:44Z',
 'fuel_type': 'petrol',
 'id': '321116eb-2129-57ae-b68c-a7e210c6064e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR84638',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 119956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-28 11:38:59 [auto1.be] INFO: Saving data for BR84638: {'auction_closing_time': 1774714544.0, 'created_time': 1774611359.688212, 'last_price_update_time': 1774697939.362319}
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR84638') HTTP/1.1" 204 0
2026-03-28 11:38:59 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW89679%27 HTTP/1.1" 200 None
2026-03-28 11:38:59 [auto1.be] INFO: Scrape type for BW89679: 2
2026-03-28 11:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679
2026-03-28 11:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with scrape type 2
2026-03-28 11:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with scrape type 2
2026-03-28 11:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1801731b-c1dd-5ecc-8d62-899ecd9b1563, identifier: BW89679
2026-03-28 11:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679
2026-03-28 11:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679
2026-03-28 11:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679 to the API
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:46:26Z',
 'fuel_type': 'diesel',
 'id': '1801731b-c1dd-5ecc-8d62-899ecd9b1563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW89679',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 141603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW89679%27 HTTP/1.1" 200 None
2026-03-28 11:38:59 [auto1.be] INFO: Saving data for BW89679: {'auction_closing_time': 1774716386.0, 'created_time': 1774611362.047716, 'last_price_update_time': 1774697939.719253}
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BW89679') HTTP/1.1" 204 0
2026-03-28 11:38:59 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 11:38:59 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-28 11:38:59 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-28 11:38:59 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-28 11:38:59 [auto1.be] INFO: Scrape type for JV18684: 2
2026-03-28 11:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-28 11:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18444be-aa2a-5ae1-b98e-e7994396df86 with scrape type 2
2026-03-28 11:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e18444be-aa2a-5ae1-b98e-e7994396df86 with scrape type 2
2026-03-28 11:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e18444be-aa2a-5ae1-b98e-e7994396df86, identifier: JV18684
2026-03-28 11:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-28 11:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-28 11:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684 to the API
2026-03-28 11:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:51:53Z',
 'fuel_type': 'diesel',
 'id': 'e18444be-aa2a-5ae1-b98e-e7994396df86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV18684',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 196540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-08',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-28 11:39:00 [auto1.be] INFO: Saving data for JV18684: {'auction_closing_time': 1774716713.0, 'created_time': 1774611356.279584, 'last_price_update_time': 1774697940.12925}
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV18684') HTTP/1.1" 204 0
2026-03-28 11:39:00 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 11:39:00 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 11:39:00 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-28 11:39:00 [auto1.be] INFO: Scrape type for RH07818: 2
2026-03-28 11:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-28 11:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcc4989-0149-5316-9c9a-6d939d6638d9 with scrape type 2
2026-03-28 11:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dcc4989-0149-5316-9c9a-6d939d6638d9 with scrape type 2
2026-03-28 11:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7dcc4989-0149-5316-9c9a-6d939d6638d9, identifier: RH07818
2026-03-28 11:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-28 11:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-28 11:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818 to the API
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:49Z',
 'fuel_type': 'petrol',
 'id': '7dcc4989-0149-5316-9c9a-6d939d6638d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH07818',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 92665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-28 11:39:00 [auto1.be] INFO: Saving data for RH07818: {'auction_closing_time': 1774716169.0, 'created_time': 1774611367.616486, 'last_price_update_time': 1774697940.495042}
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH07818') HTTP/1.1" 204 0
2026-03-28 11:39:00 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 11:39:00 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV58178%27 HTTP/1.1" 200 None
2026-03-28 11:39:00 [auto1.be] INFO: Scrape type for KV58178: 2
2026-03-28 11:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178
2026-03-28 11:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13651d99-374d-5e33-8a53-ff4f5a1243bd with scrape type 2
2026-03-28 11:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13651d99-374d-5e33-8a53-ff4f5a1243bd with scrape type 2
2026-03-28 11:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 13651d99-374d-5e33-8a53-ff4f5a1243bd, identifier: KV58178
2026-03-28 11:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178
2026-03-28 11:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178
2026-03-28 11:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178 to the API
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:52:05Z',
 'fuel_type': 'diesel',
 'id': '13651d99-374d-5e33-8a53-ff4f5a1243bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV58178',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 207524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-20',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 S',
 'transmission': 'automatic',
 'trim': 'TDV6 S',
 'year': 2011}
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV58178%27 HTTP/1.1" 200 None
2026-03-28 11:39:00 [auto1.be] INFO: Saving data for KV58178: {'auction_closing_time': 1774716725.0, 'created_time': 1774611361.482143, 'last_price_update_time': 1774697940.952297}
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV58178') HTTP/1.1" 204 0
2026-03-28 11:39:00 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-28 11:39:00 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-28 11:39:00 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-28 11:39:00 [auto1.be] INFO: Scrape type for ES19550: 2
2026-03-28 11:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-28 11:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd055418-f39a-5fdf-870a-43303d4beb5b with scrape type 2
2026-03-28 11:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd055418-f39a-5fdf-870a-43303d4beb5b with scrape type 2
2026-03-28 11:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd055418-f39a-5fdf-870a-43303d4beb5b, identifier: ES19550
2026-03-28 11:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-28 11:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-28 11:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550 to the API
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:21:16Z',
 'fuel_type': 'hybrid',
 'id': 'fd055418-f39a-5fdf-870a-43303d4beb5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES19550',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 157904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-28 11:39:01 [auto1.be] INFO: Saving data for ES19550: {'auction_closing_time': 1774714876.0, 'created_time': 1773301743.386105, 'last_price_update_time': 1774697941.356725}
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES19550') HTTP/1.1" 204 0
2026-03-28 11:39:01 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 11:39:01 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-28 11:39:01 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 11:39:01 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-28 11:39:01 [auto1.be] INFO: Scrape type for EM18277: 2
2026-03-28 11:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-28 11:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db494d34-2045-59d5-9f77-55413ffc9d5a with scrape type 2
2026-03-28 11:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db494d34-2045-59d5-9f77-55413ffc9d5a with scrape type 2
2026-03-28 11:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db494d34-2045-59d5-9f77-55413ffc9d5a, identifier: EM18277
2026-03-28 11:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-28 11:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-28 11:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277 to the API
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'petrol',
 'id': 'db494d34-2045-59d5-9f77-55413ffc9d5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM18277',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 59465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-04',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-28 11:39:01 [auto1.be] INFO: Saving data for EM18277: {'auction_closing_time': 1774716349.0, 'created_time': 1773693560.455665, 'last_price_update_time': 1774697941.738975}
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM18277') HTTP/1.1" 204 0
2026-03-28 11:39:01 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-28 11:39:01 [auto1.be] INFO: Scrape type for KX60472: 2
2026-03-28 11:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-28 11:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f9931b-e043-58de-a6a3-ac39d976e4dd with scrape type 2
2026-03-28 11:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f9931b-e043-58de-a6a3-ac39d976e4dd with scrape type 2
2026-03-28 11:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a7f9931b-e043-58de-a6a3-ac39d976e4dd, identifier: KX60472
2026-03-28 11:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-28 11:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-28 11:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472 to the API
2026-03-28 11:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:58:23Z',
 'fuel_type': 'hybrid',
 'id': 'a7f9931b-e043-58de-a6a3-ac39d976e4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX60472',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 106875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-28 11:39:02 [auto1.be] INFO: Saving data for KX60472: {'auction_closing_time': 1774717103.0, 'created_time': 1773866331.134586, 'last_price_update_time': 1774697942.11683}
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX60472') HTTP/1.1" 204 0
2026-03-28 11:39:02 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 11:39:02 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-28 11:39:02 [auto1.be] INFO: Scrape type for HM69306: 2
2026-03-28 11:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-28 11:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11edb87a-b955-50bc-9cae-bc9047662547 with scrape type 2
2026-03-28 11:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11edb87a-b955-50bc-9cae-bc9047662547 with scrape type 2
2026-03-28 11:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11edb87a-b955-50bc-9cae-bc9047662547, identifier: HM69306
2026-03-28 11:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-28 11:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-28 11:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306 to the API
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:29:10Z',
 'fuel_type': 'petrol',
 'id': '11edb87a-b955-50bc-9cae-bc9047662547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM69306',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 63711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2016}
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-28 11:39:02 [auto1.be] INFO: Saving data for HM69306: {'auction_closing_time': 1774715350.0, 'created_time': 1773780008.269331, 'last_price_update_time': 1774697942.485294}
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM69306') HTTP/1.1" 204 0
2026-03-28 11:39:02 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-28 11:39:02 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-28 11:39:02 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 11:39:02 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN53703%27 HTTP/1.1" 200 None
2026-03-28 11:39:02 [auto1.be] INFO: Scrape type for UN53703: 0
2026-03-28 11:39:02 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 11:39:02 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-28 11:39:02 [auto1.be] INFO: Scrape type for GG55355: 2
2026-03-28 11:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-28 11:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7bc5fe3-7a0a-591e-b851-acb764baf9fd with scrape type 2
2026-03-28 11:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7bc5fe3-7a0a-591e-b851-acb764baf9fd with scrape type 2
2026-03-28 11:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7bc5fe3-7a0a-591e-b851-acb764baf9fd, identifier: GG55355
2026-03-28 11:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-28 11:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-28 11:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355 to the API
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:34:58Z',
 'fuel_type': 'petrol',
 'id': 'd7bc5fe3-7a0a-591e-b851-acb764baf9fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG55355',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 75467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T3 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-28 11:39:02 [auto1.be] INFO: Saving data for GG55355: {'auction_closing_time': 1774715698.0, 'created_time': 1773779753.352337, 'last_price_update_time': 1774697942.999055}
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG55355') HTTP/1.1" 204 0
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-28 11:39:03 [auto1.be] INFO: Scrape type for EG19315: 2
2026-03-28 11:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-28 11:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77e8956-d519-58ae-ae3a-8a4acd615628 with scrape type 2
2026-03-28 11:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77e8956-d519-58ae-ae3a-8a4acd615628 with scrape type 2
2026-03-28 11:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b77e8956-d519-58ae-ae3a-8a4acd615628, identifier: EG19315
2026-03-28 11:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-28 11:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-28 11:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315 to the API
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:33:25Z',
 'fuel_type': 'diesel',
 'id': 'b77e8956-d519-58ae-ae3a-8a4acd615628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG19315',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 127087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Driver M',
 'transmission': 'manual',
 'trim': 'Driver M',
 'year': 2019}
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-28 11:39:03 [auto1.be] INFO: Saving data for EG19315: {'auction_closing_time': 1774715605.0, 'created_time': 1773866679.754294, 'last_price_update_time': 1774697943.37966}
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EG19315') HTTP/1.1" 204 0
2026-03-28 11:39:03 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1821 | hits on page: 40
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-28 11:39:03 [auto1.be] INFO: Scrape type for CP13942: 2
2026-03-28 11:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-28 11:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4338ebf-0eaf-5282-8686-1617935d6bb1 with scrape type 2
2026-03-28 11:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4338ebf-0eaf-5282-8686-1617935d6bb1 with scrape type 2
2026-03-28 11:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4338ebf-0eaf-5282-8686-1617935d6bb1, identifier: CP13942
2026-03-28 11:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-28 11:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-28 11:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942 to the API
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:15:00Z',
 'fuel_type': 'petrol',
 'id': 'b4338ebf-0eaf-5282-8686-1617935d6bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP13942',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 132096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-28 11:39:03 [auto1.be] INFO: Saving data for CP13942: {'auction_closing_time': 1774714500.0, 'created_time': 1773136511.516096, 'last_price_update_time': 1774697943.758214}
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP13942') HTTP/1.1" 204 0
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-28 11:39:03 [auto1.be] INFO: Scrape type for HY77866: 2
2026-03-28 11:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-28 11:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c36cbd77-692c-5182-ad19-5eaa5a51c369 with scrape type 2
2026-03-28 11:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c36cbd77-692c-5182-ad19-5eaa5a51c369 with scrape type 2
2026-03-28 11:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c36cbd77-692c-5182-ad19-5eaa5a51c369, identifier: HY77866
2026-03-28 11:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 11:39:03 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-28 11:39:03 [auto1.be] INFO: Scrape type for CB53563: 2
2026-03-28 11:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-28 11:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ebb0529-d9de-5be2-821d-77f9a0813017 with scrape type 2
2026-03-28 11:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ebb0529-d9de-5be2-821d-77f9a0813017 with scrape type 2
2026-03-28 11:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ebb0529-d9de-5be2-821d-77f9a0813017, identifier: CB53563
2026-03-28 11:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-28 11:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-28 11:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866 to the API
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:41Z',
 'fuel_type': 'diesel',
 'id': 'c36cbd77-692c-5182-ad19-5eaa5a51c369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY77866',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 335380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-28 11:39:04 [auto1.be] INFO: Saving data for HY77866: {'auction_closing_time': 1774717061.0, 'created_time': 1773301748.141352, 'last_price_update_time': 1774697944.249626}
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY77866') HTTP/1.1" 204 0
2026-03-28 11:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-28 11:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-28 11:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563 to the API
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:17:58Z',
 'fuel_type': 'diesel',
 'id': '8ebb0529-d9de-5be2-821d-77f9a0813017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB53563',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 179557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang FWD',
 'transmission': 'automatic',
 'trim': 'Kasten 35 mittellang FWD',
 'year': 2022}
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-28 11:39:04 [auto1.be] INFO: Saving data for CB53563: {'auction_closing_time': 1774714678.0, 'created_time': 1773866674.169586, 'last_price_update_time': 1774697944.614936}
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB53563') HTTP/1.1" 204 0
2026-03-28 11:39:04 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 11:39:04 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 11:39:04 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-28 11:39:04 [auto1.be] INFO: Scrape type for ZS27075: 2
2026-03-28 11:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-28 11:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678b62c0-d967-5808-b137-82e400e254d3 with scrape type 2
2026-03-28 11:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 678b62c0-d967-5808-b137-82e400e254d3 with scrape type 2
2026-03-28 11:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 678b62c0-d967-5808-b137-82e400e254d3, identifier: ZS27075
2026-03-28 11:39:04 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-28 11:39:04 [auto1.be] INFO: Scrape type for XC12599: 2
2026-03-28 11:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-28 11:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with scrape type 2
2026-03-28 11:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with scrape type 2
2026-03-28 11:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f, identifier: XC12599
2026-03-28 11:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-28 11:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-28 11:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075 to the API
2026-03-28 11:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:30:03Z',
 'fuel_type': 'petrol',
 'id': '678b62c0-d967-5808-b137-82e400e254d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS27075',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 212246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2012}
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-28 11:39:05 [auto1.be] INFO: Saving data for ZS27075: {'auction_closing_time': 1774715403.0, 'created_time': 1773132399.338948, 'last_price_update_time': 1774697945.126991}
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS27075') HTTP/1.1" 204 0
2026-03-28 11:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-28 11:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-28 11:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599 to the API
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:40:15Z',
 'fuel_type': 'diesel',
 'id': 'a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC12599',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 287576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-29',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-28 11:39:05 [auto1.be] INFO: Saving data for XC12599: {'auction_closing_time': 1774716015.0, 'created_time': 1773223786.475416, 'last_price_update_time': 1774697945.409828}
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC12599') HTTP/1.1" 204 0
2026-03-28 11:39:05 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-28 11:39:05 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-28 11:39:05 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-28 11:39:05 [auto1.be] INFO: Scrape type for YA85838: 2
2026-03-28 11:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-28 11:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d36432f7-496c-5fc3-813c-05aae0902e94 with scrape type 2
2026-03-28 11:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d36432f7-496c-5fc3-813c-05aae0902e94 with scrape type 2
2026-03-28 11:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d36432f7-496c-5fc3-813c-05aae0902e94, identifier: YA85838
2026-03-28 11:39:05 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 11:39:05 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-28 11:39:05 [auto1.be] INFO: Scrape type for CG84069: 2
2026-03-28 11:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-28 11:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with scrape type 2
2026-03-28 11:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with scrape type 2
2026-03-28 11:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d67f2ac4-30c7-5b28-8227-5bc9aae0f290, identifier: CG84069
2026-03-28 11:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-28 11:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-28 11:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838 to the API
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:38Z',
 'fuel_type': 'diesel',
 'id': 'd36432f7-496c-5fc3-813c-05aae0902e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA85838',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 288011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-06',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2014}
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-28 11:39:05 [auto1.be] INFO: Saving data for YA85838: {'auction_closing_time': 1774715378.0, 'created_time': 1774298173.703762, 'last_price_update_time': 1774697945.903583}
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA85838') HTTP/1.1" 204 0
2026-03-28 11:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-28 11:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-28 11:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069 to the API
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:32:59Z',
 'fuel_type': 'diesel',
 'id': 'd67f2ac4-30c7-5b28-8227-5bc9aae0f290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG84069',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Spacetourer',
 'odometer': 123027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-02',
 'seller_name': None,
 'title': 'Citroen C4 Spacetourer 1.5 Blue-HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2019}
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-28 11:39:06 [auto1.be] INFO: Saving data for CG84069: {'auction_closing_time': 1774715579.0, 'created_time': 1773747335.363558, 'last_price_update_time': 1774697946.174669}
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG84069') HTTP/1.1" 204 0
2026-03-28 11:39:06 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 11:39:06 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 11:39:06 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-28 11:39:06 [auto1.be] INFO: Scrape type for DK43204: 2
2026-03-28 11:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-28 11:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2107a4-633a-53da-93b0-31ec43c84d96 with scrape type 2
2026-03-28 11:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c2107a4-633a-53da-93b0-31ec43c84d96 with scrape type 2
2026-03-28 11:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c2107a4-633a-53da-93b0-31ec43c84d96, identifier: DK43204
2026-03-28 11:39:06 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-28 11:39:06 [auto1.be] INFO: Scrape type for GV27154: 2
2026-03-28 11:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-28 11:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c972566e-1eff-57d5-a499-b4acc929719c with scrape type 2
2026-03-28 11:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c972566e-1eff-57d5-a499-b4acc929719c with scrape type 2
2026-03-28 11:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c972566e-1eff-57d5-a499-b4acc929719c, identifier: GV27154
2026-03-28 11:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-28 11:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-28 11:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204 to the API
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:38:49Z',
 'fuel_type': 'petrol',
 'id': '8c2107a4-633a-53da-93b0-31ec43c84d96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK43204',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 15318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2019}
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-28 11:39:06 [auto1.be] INFO: Saving data for DK43204: {'auction_closing_time': 1774715929.0, 'created_time': 1774298339.746073, 'last_price_update_time': 1774697946.64755}
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK43204') HTTP/1.1" 204 0
2026-03-28 11:39:06 [scrapy.extensions.logstats] INFO: Crawled 164 pages (at 14 pages/min), scraped 187 items (at 61 items/min)
2026-03-28 11:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-28 11:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-28 11:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154 to the API
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:11:48Z',
 'fuel_type': 'diesel',
 'id': 'c972566e-1eff-57d5-a499-b4acc929719c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV27154',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 242398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-24',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-28 11:39:07 [auto1.be] INFO: Saving data for GV27154: {'auction_closing_time': 1774714308.0, 'created_time': 1773866349.363217, 'last_price_update_time': 1774697947.011698}
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GV27154') HTTP/1.1" 204 0
2026-03-28 11:39:07 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-28 11:39:07 [auto1.be] INFO: Scrape type for WU38196: 2
2026-03-28 11:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-28 11:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with scrape type 2
2026-03-28 11:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with scrape type 2
2026-03-28 11:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0, identifier: WU38196
2026-03-28 11:39:07 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 11:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-28 11:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-28 11:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196 to the API
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:15:54Z',
 'fuel_type': 'petrol',
 'id': '17fcbdae-1902-5522-b6ca-a8d2f3691eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU38196',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 72881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-27',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2010}
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-28 11:39:07 [auto1.be] INFO: Saving data for WU38196: {'auction_closing_time': 1774714554.0, 'created_time': 1774298351.381626, 'last_price_update_time': 1774697947.385887}
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU38196') HTTP/1.1" 204 0
2026-03-28 11:39:07 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-28 11:39:07 [auto1.be] INFO: Scrape type for AK84541: 2
2026-03-28 11:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-28 11:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with scrape type 2
2026-03-28 11:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with scrape type 2
2026-03-28 11:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9, identifier: AK84541
2026-03-28 11:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-28 11:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-28 11:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541 to the API
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:17:16Z',
 'fuel_type': 'diesel',
 'id': 'e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK84541',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 182639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2014}
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-28 11:39:07 [auto1.be] INFO: Saving data for AK84541: {'auction_closing_time': 1774714636.0, 'created_time': 1773693866.665572, 'last_price_update_time': 1774697947.788595}
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK84541') HTTP/1.1" 204 0
2026-03-28 11:39:07 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-28 11:39:07 [auto1.be] INFO: Scrape type for NB09051: 2
2026-03-28 11:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-28 11:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b2c403-f651-58aa-ae25-5fef150b7bd4 with scrape type 2
2026-03-28 11:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b2c403-f651-58aa-ae25-5fef150b7bd4 with scrape type 2
2026-03-28 11:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58b2c403-f651-58aa-ae25-5fef150b7bd4, identifier: NB09051
2026-03-28 11:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-28 11:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-28 11:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051 to the API
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:30:50Z',
 'fuel_type': 'diesel',
 'id': '58b2c403-f651-58aa-ae25-5fef150b7bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB09051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 41307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-28 11:39:08 [auto1.be] INFO: Saving data for NB09051: {'auction_closing_time': 1774715450.0, 'created_time': 1773909348.125255, 'last_price_update_time': 1774697948.173917}
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB09051') HTTP/1.1" 204 0
2026-03-28 11:39:08 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 11:39:08 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 11:39:08 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 11:39:08 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60132%27 HTTP/1.1" 200 None
2026-03-28 11:39:08 [auto1.be] INFO: Scrape type for YJ60132: 2
2026-03-28 11:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132
2026-03-28 11:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff22587-a47f-5bc3-8668-0a3488d72f8a with scrape type 2
2026-03-28 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff22587-a47f-5bc3-8668-0a3488d72f8a with scrape type 2
2026-03-28 11:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dff22587-a47f-5bc3-8668-0a3488d72f8a, identifier: YJ60132
2026-03-28 11:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132
2026-03-28 11:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132
2026-03-28 11:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132 to the API
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-28T16:39:31Z',
 'fuel_type': 'diesel',
 'id': 'dff22587-a47f-5bc3-8668-0a3488d72f8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ60132',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 319860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-13',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60132%27 HTTP/1.1" 200 None
2026-03-28 11:39:08 [auto1.be] INFO: Saving data for YJ60132: {'auction_closing_time': 1774715971.0, 'created_time': 1773909347.356356, 'last_price_update_time': 1774697948.539084}
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ60132') HTTP/1.1" 204 0
2026-03-28 11:39:08 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-28 11:39:08 [auto1.be] INFO: Scrape type for WE53696: 2
2026-03-28 11:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-28 11:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a483acd3-a45f-5997-81bc-8906e425df72 with scrape type 2
2026-03-28 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a483acd3-a45f-5997-81bc-8906e425df72 with scrape type 2
2026-03-28 11:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a483acd3-a45f-5997-81bc-8906e425df72, identifier: WE53696
2026-03-28 11:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-28 11:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-28 11:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696 to the API
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:16:19Z',
 'fuel_type': 'diesel',
 'id': 'a483acd3-a45f-5997-81bc-8906e425df72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE53696',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 251640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-08',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-28 11:39:08 [auto1.be] INFO: Saving data for WE53696: {'auction_closing_time': 1774714579.0, 'created_time': 1773136331.225977, 'last_price_update_time': 1774697948.950355}
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE53696') HTTP/1.1" 204 0
2026-03-28 11:39:08 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 11:39:08 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-28 11:39:08 [auto1.be] INFO: Scrape type for AV34296: 2
2026-03-28 11:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-28 11:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with scrape type 2
2026-03-28 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with scrape type 2
2026-03-28 11:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb, identifier: AV34296
2026-03-28 11:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-28 11:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-28 11:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296 to the API
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'diesel',
 'id': '34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV34296',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 209412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2017}
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-28 11:39:09 [auto1.be] INFO: Saving data for AV34296: {'auction_closing_time': 1774715126.0, 'created_time': 1773134257.558797, 'last_price_update_time': 1774697949.350135}
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV34296') HTTP/1.1" 204 0
2026-03-28 11:39:09 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-28 11:39:09 [auto1.be] INFO: Scrape type for YJ44532: 2
2026-03-28 11:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-28 11:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50a7a112-8ff5-5456-9337-a4b1c69f3112 with scrape type 2
2026-03-28 11:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50a7a112-8ff5-5456-9337-a4b1c69f3112 with scrape type 2
2026-03-28 11:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 50a7a112-8ff5-5456-9337-a4b1c69f3112, identifier: YJ44532
2026-03-28 11:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-28 11:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-28 11:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532 to the API
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:20:46Z',
 'fuel_type': 'diesel',
 'id': '50a7a112-8ff5-5456-9337-a4b1c69f3112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ44532',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 151596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-29',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2012}
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-28 11:39:09 [auto1.be] INFO: Saving data for YJ44532: {'auction_closing_time': 1774714846.0, 'created_time': 1773239951.955512, 'last_price_update_time': 1774697949.827856}
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ44532') HTTP/1.1" 204 0
2026-03-28 11:39:09 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 11:39:09 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-28 11:39:09 [auto1.be] INFO: Scrape type for LH25651: 2
2026-03-28 11:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-28 11:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e9aa645-1b32-55df-a761-c8a57744de08 with scrape type 2
2026-03-28 11:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e9aa645-1b32-55df-a761-c8a57744de08 with scrape type 2
2026-03-28 11:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e9aa645-1b32-55df-a761-c8a57744de08, identifier: LH25651
2026-03-28 11:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-28 11:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-28 11:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651 to the API
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:47Z',
 'fuel_type': 'diesel',
 'id': '2e9aa645-1b32-55df-a761-c8a57744de08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH25651',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 250339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'manual',
 'trim': 'Standard',
 'year': 2009}
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-28 11:39:10 [auto1.be] INFO: Saving data for LH25651: {'auction_closing_time': 1774717007.0, 'created_time': 1773747602.992207, 'last_price_update_time': 1774697950.258309}
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH25651') HTTP/1.1" 204 0
2026-03-28 11:39:10 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1821 | hits on page: 40
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ69250%27 HTTP/1.1" 200 None
2026-03-28 11:39:10 [auto1.be] INFO: Scrape type for FJ69250: 0
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-28 11:39:10 [auto1.be] INFO: Scrape type for VM12927: 2
2026-03-28 11:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-28 11:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with scrape type 2
2026-03-28 11:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with scrape type 2
2026-03-28 11:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b77ff12a-c863-558f-a8b3-18a5a93cc3c5, identifier: VM12927
2026-03-28 11:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-28 11:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-28 11:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927 to the API
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:56:49Z',
 'fuel_type': 'hybrid',
 'id': 'b77ff12a-c863-558f-a8b3-18a5a93cc3c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM12927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 258698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-28 11:39:10 [auto1.be] INFO: Saving data for VM12927: {'auction_closing_time': 1774717009.0, 'created_time': 1773780048.69132, 'last_price_update_time': 1774697950.649626}
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM12927') HTTP/1.1" 204 0
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-28 11:39:10 [auto1.be] INFO: Scrape type for XH49609: 2
2026-03-28 11:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-28 11:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec243356-4b5e-56a2-872a-716191b3a987 with scrape type 2
2026-03-28 11:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec243356-4b5e-56a2-872a-716191b3a987 with scrape type 2
2026-03-28 11:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec243356-4b5e-56a2-872a-716191b3a987, identifier: XH49609
2026-03-28 11:39:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:39:10 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-28 11:39:10 [auto1.be] INFO: Scrape type for TM97404: 2
2026-03-28 11:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-28 11:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with scrape type 2
2026-03-28 11:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with scrape type 2
2026-03-28 11:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2, identifier: TM97404
2026-03-28 11:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-28 11:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-28 11:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609 to the API
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:11:57Z',
 'fuel_type': 'diesel',
 'id': 'ec243356-4b5e-56a2-872a-716191b3a987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH49609',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'BMW 1er 114d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-28 11:39:11 [auto1.be] INFO: Saving data for XH49609: {'auction_closing_time': 1774714317.0, 'created_time': 1773238225.544476, 'last_price_update_time': 1774697951.227024}
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH49609') HTTP/1.1" 204 0
2026-03-28 11:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-28 11:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-28 11:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404 to the API
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:16:34Z',
 'fuel_type': 'diesel',
 'id': '0f0e0f58-7dbf-506b-b74a-e2d3445dacf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM97404',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 246819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-28 11:39:11 [auto1.be] INFO: Saving data for TM97404: {'auction_closing_time': 1774714594.0, 'created_time': 1773240294.153355, 'last_price_update_time': 1774697951.518718}
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM97404') HTTP/1.1" 204 0
2026-03-28 11:39:11 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 11:39:11 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-28 11:39:11 [auto1.be] INFO: Scrape type for BS55977: 2
2026-03-28 11:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-28 11:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with scrape type 2
2026-03-28 11:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with scrape type 2
2026-03-28 11:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d, identifier: BS55977
2026-03-28 11:39:11 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB60498%27 HTTP/1.1" 200 None
2026-03-28 11:39:11 [auto1.be] INFO: Scrape type for CB60498: 2
2026-03-28 11:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498
2026-03-28 11:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with scrape type 2
2026-03-28 11:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with scrape type 2
2026-03-28 11:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63, identifier: CB60498
2026-03-28 11:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-28 11:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-28 11:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977 to the API
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:24:21Z',
 'fuel_type': 'petrol',
 'id': 'f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS55977',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 21978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-13',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2022}
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-28 11:39:11 [auto1.be] INFO: Saving data for BS55977: {'auction_closing_time': 1774715061.0, 'created_time': 1773693669.341309, 'last_price_update_time': 1774697951.983846}
2026-03-28 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BS55977') HTTP/1.1" 204 0
2026-03-28 11:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498
2026-03-28 11:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498
2026-03-28 11:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498 to the API
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:58Z',
 'fuel_type': 'petrol',
 'id': '0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB60498',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 70778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB60498%27 HTTP/1.1" 200 None
2026-03-28 11:39:12 [auto1.be] INFO: Saving data for CB60498: {'auction_closing_time': 1774713958.0, 'created_time': 1774611394.44101, 'last_price_update_time': 1774697952.244897}
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB60498') HTTP/1.1" 204 0
2026-03-28 11:39:12 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-28 11:39:12 [auto1.be] INFO: Scrape type for BX96549: 2
2026-03-28 11:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-28 11:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9932f2-b2a2-5d1b-9377-395ab8386859 with scrape type 2
2026-03-28 11:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9932f2-b2a2-5d1b-9377-395ab8386859 with scrape type 2
2026-03-28 11:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec9932f2-b2a2-5d1b-9377-395ab8386859, identifier: BX96549
2026-03-28 11:39:12 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 11:39:12 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-28 11:39:12 [auto1.be] INFO: Scrape type for VE52917: 2
2026-03-28 11:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-28 11:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with scrape type 2
2026-03-28 11:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with scrape type 2
2026-03-28 11:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15ea9686-0119-52b0-8be3-4e94efd1c0e1, identifier: VE52917
2026-03-28 11:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-28 11:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-28 11:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549 to the API
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:32Z',
 'fuel_type': 'diesel',
 'id': 'ec9932f2-b2a2-5d1b-9377-395ab8386859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX96549',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 224163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Advantage',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Advantage',
 'year': 2016}
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-28 11:39:12 [auto1.be] INFO: Saving data for BX96549: {'auction_closing_time': 1774714712.0, 'created_time': 1773693532.930734, 'last_price_update_time': 1774697952.749709}
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX96549') HTTP/1.1" 204 0
2026-03-28 11:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-28 11:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-28 11:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917 to the API
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:27:00Z',
 'fuel_type': 'diesel',
 'id': '15ea9686-0119-52b0-8be3-4e94efd1c0e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE52917',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 206189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Saving data for VE52917: {'auction_closing_time': 1774715220.0, 'created_time': 1773693578.098352, 'last_price_update_time': 1774697953.026734}
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE52917') HTTP/1.1" 204 0
2026-03-28 11:39:13 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-28 11:39:13 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Scrape type for GJ23391: 2
2026-03-28 11:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-28 11:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85591b64-c2d3-5cb9-b784-f430dca1e622 with scrape type 2
2026-03-28 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85591b64-c2d3-5cb9-b784-f430dca1e622 with scrape type 2
2026-03-28 11:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 85591b64-c2d3-5cb9-b784-f430dca1e622, identifier: GJ23391
2026-03-28 11:39:13 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-28 11:39:13 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-28 11:39:13 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Scrape type for YF28674: 2
2026-03-28 11:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-28 11:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dbd15a-1c73-5853-ab10-b6e315cb2479 with scrape type 2
2026-03-28 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45dbd15a-1c73-5853-ab10-b6e315cb2479 with scrape type 2
2026-03-28 11:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45dbd15a-1c73-5853-ab10-b6e315cb2479, identifier: YF28674
2026-03-28 11:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-28 11:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-28 11:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391 to the API
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:19Z',
 'fuel_type': 'diesel',
 'id': '85591b64-c2d3-5cb9-b784-f430dca1e622',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ23391',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 172410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.8 HDi Tendance 2WD',
 'transmission': 'manual',
 'trim': 'Tendance 2WD',
 'year': 2012}
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Saving data for GJ23391: {'auction_closing_time': 1774715839.0, 'created_time': 1774298344.268251, 'last_price_update_time': 1774697953.54074}
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ23391') HTTP/1.1" 204 0
2026-03-28 11:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-28 11:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-28 11:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674 to the API
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:13Z',
 'fuel_type': 'petrol',
 'id': '45dbd15a-1c73-5853-ab10-b6e315cb2479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF28674',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 19883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Saving data for YF28674: {'auction_closing_time': 1774715113.0, 'created_time': 1774298191.047787, 'last_price_update_time': 1774697953.889733}
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF28674') HTTP/1.1" 204 0
2026-03-28 11:39:13 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-28 11:39:13 [auto1.be] INFO: Scrape type for XH30316: 2
2026-03-28 11:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-28 11:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee85060-27dd-5afa-b939-7b47d18b1efe with scrape type 2
2026-03-28 11:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee85060-27dd-5afa-b939-7b47d18b1efe with scrape type 2
2026-03-28 11:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bee85060-27dd-5afa-b939-7b47d18b1efe, identifier: XH30316
2026-03-28 11:39:14 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 11:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-28 11:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-28 11:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316 to the API
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:58Z',
 'fuel_type': 'diesel',
 'id': 'bee85060-27dd-5afa-b939-7b47d18b1efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH30316',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 199358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-03',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-28 11:39:14 [auto1.be] INFO: Saving data for XH30316: {'auction_closing_time': 1774713778.0, 'created_time': 1774125442.068833, 'last_price_update_time': 1774697954.284002}
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH30316') HTTP/1.1" 204 0
2026-03-28 11:39:14 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 11:39:14 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-28 11:39:14 [auto1.be] INFO: Scrape type for KG87325: 2
2026-03-28 11:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-28 11:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with scrape type 2
2026-03-28 11:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with scrape type 2
2026-03-28 11:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9aa4639-2eaf-5832-a89a-6c46f6cc5691, identifier: KG87325
2026-03-28 11:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-28 11:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-28 11:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325 to the API
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:00:05Z',
 'fuel_type': 'hybrid',
 'id': 'f9aa4639-2eaf-5832-a89a-6c46f6cc5691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG87325',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 12326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-28 11:39:14 [auto1.be] INFO: Saving data for KG87325: {'auction_closing_time': 1774713605.0, 'created_time': 1773779734.955477, 'last_price_update_time': 1774697954.678421}
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG87325') HTTP/1.1" 204 0
2026-03-28 11:39:14 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-28 11:39:14 [auto1.be] INFO: Scrape type for EL84394: 2
2026-03-28 11:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-28 11:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with scrape type 2
2026-03-28 11:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with scrape type 2
2026-03-28 11:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8, identifier: EL84394
2026-03-28 11:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-28 11:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-28 11:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394 to the API
2026-03-28 11:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:55:30Z',
 'fuel_type': 'diesel',
 'id': '6af9df9e-805c-593d-b9c7-94b4a8aff7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL84394',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 203556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-13',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2012}
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-28 11:39:15 [auto1.be] INFO: Saving data for EL84394: {'auction_closing_time': 1774716930.0, 'created_time': 1774298369.62793, 'last_price_update_time': 1774697955.249343}
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL84394') HTTP/1.1" 204 0
2026-03-28 11:39:15 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-28 11:39:15 [auto1.be] INFO: Scrape type for PB96026: 2
2026-03-28 11:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-28 11:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b91f928b-f874-5089-9023-8a78fc38d4f1 with scrape type 2
2026-03-28 11:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b91f928b-f874-5089-9023-8a78fc38d4f1 with scrape type 2
2026-03-28 11:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b91f928b-f874-5089-9023-8a78fc38d4f1, identifier: PB96026
2026-03-28 11:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-28 11:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-28 11:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026 to the API
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:41Z',
 'fuel_type': 'diesel',
 'id': 'b91f928b-f874-5089-9023-8a78fc38d4f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB96026',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 149525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-12',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-28 11:39:15 [auto1.be] INFO: Saving data for PB96026: {'auction_closing_time': 1774715501.0, 'created_time': 1773693513.849546, 'last_price_update_time': 1774697955.645233}
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB96026') HTTP/1.1" 204 0
2026-03-28 11:39:15 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-28 11:39:15 [auto1.be] INFO: Scrape type for RA81540: 2
2026-03-28 11:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-28 11:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b72f69-60b5-5888-aa23-9f9a474ddc4d with scrape type 2
2026-03-28 11:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b72f69-60b5-5888-aa23-9f9a474ddc4d with scrape type 2
2026-03-28 11:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15b72f69-60b5-5888-aa23-9f9a474ddc4d, identifier: RA81540
2026-03-28 11:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-28 11:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-28 11:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540 to the API
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:31Z',
 'fuel_type': 'petrol',
 'id': '15b72f69-60b5-5888-aa23-9f9a474ddc4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA81540',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 113473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line R&B',
 'transmission': 'manual',
 'trim': 'ST-Line R&B',
 'year': 2018}
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Saving data for RA81540: {'auction_closing_time': 1774715251.0, 'created_time': 1773240354.480115, 'last_price_update_time': 1774697956.031355}
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA81540') HTTP/1.1" 204 0
2026-03-28 11:39:16 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-28 11:39:16 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-28 11:39:16 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Scrape type for FV97066: 2
2026-03-28 11:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-28 11:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with scrape type 2
2026-03-28 11:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with scrape type 2
2026-03-28 11:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a, identifier: FV97066
2026-03-28 11:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-28 11:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-28 11:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066 to the API
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:43Z',
 'fuel_type': 'diesel',
 'id': 'fd805b55-1afb-5b07-be74-9ab9ca9b2d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV97066',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 127856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-15',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Saving data for FV97066: {'auction_closing_time': 1774716103.0, 'created_time': 1773866726.442018, 'last_price_update_time': 1774697956.475971}
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV97066') HTTP/1.1" 204 0
2026-03-28 11:39:16 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Scrape type for NC04706: 2
2026-03-28 11:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-28 11:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with scrape type 2
2026-03-28 11:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with scrape type 2
2026-03-28 11:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c, identifier: NC04706
2026-03-28 11:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-28 11:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-28 11:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706 to the API
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:16Z',
 'fuel_type': 'petrol',
 'id': '1a8552fe-0a7c-5d45-81b2-892f66bfb54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC04706',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 123913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Saving data for NC04706: {'auction_closing_time': 1774716136.0, 'created_time': 1774298376.631374, 'last_price_update_time': 1774697956.873392}
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC04706') HTTP/1.1" 204 0
2026-03-28 11:39:16 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-28 11:39:16 [auto1.be] INFO: Scrape type for LU38585: 2
2026-03-28 11:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-28 11:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466d7955-e321-5c6f-9a00-6c3bbb48a33e with scrape type 2
2026-03-28 11:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466d7955-e321-5c6f-9a00-6c3bbb48a33e with scrape type 2
2026-03-28 11:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 466d7955-e321-5c6f-9a00-6c3bbb48a33e, identifier: LU38585
2026-03-28 11:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-28 11:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-28 11:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585 to the API
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:38Z',
 'fuel_type': 'petrol',
 'id': '466d7955-e321-5c6f-9a00-6c3bbb48a33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU38585',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-14',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-28 11:39:17 [auto1.be] INFO: Saving data for LU38585: {'auction_closing_time': 1774715858.0, 'created_time': 1773736534.981773, 'last_price_update_time': 1774697957.846223}
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LU38585') HTTP/1.1" 204 0
2026-03-28 11:39:17 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 11:39:17 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 11:39:17 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 11:39:17 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 11:39:17 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD51863%27 HTTP/1.1" 200 None
2026-03-28 11:39:17 [auto1.be] INFO: Scrape type for ZD51863: 2
2026-03-28 11:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863
2026-03-28 11:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8714701-4a86-58f7-97e7-d7056e4a0963 with scrape type 2
2026-03-28 11:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8714701-4a86-58f7-97e7-d7056e4a0963 with scrape type 2
2026-03-28 11:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8714701-4a86-58f7-97e7-d7056e4a0963, identifier: ZD51863
2026-03-28 11:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863
2026-03-28 11:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863
2026-03-28 11:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863 to the API
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:01:28Z',
 'fuel_type': 'diesel',
 'id': 'a8714701-4a86-58f7-97e7-d7056e4a0963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD51863',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 276980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-19',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Comfortline',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline',
 'year': 2012}
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD51863%27 HTTP/1.1" 200 None
2026-03-28 11:39:18 [auto1.be] INFO: Saving data for ZD51863: {'auction_closing_time': 1774713688.0, 'created_time': 1774298293.941346, 'last_price_update_time': 1774697958.244995}
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD51863') HTTP/1.1" 204 0
2026-03-28 11:39:18 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 11:39:18 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 11:39:18 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 11:39:18 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 11:39:18 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-28 11:39:18 [auto1.be] INFO: Scrape type for UT04463: 2
2026-03-28 11:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-28 11:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab6c094-4925-54cd-a193-7a20a3b2c51d with scrape type 2
2026-03-28 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab6c094-4925-54cd-a193-7a20a3b2c51d with scrape type 2
2026-03-28 11:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ab6c094-4925-54cd-a193-7a20a3b2c51d, identifier: UT04463
2026-03-28 11:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-28 11:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-28 11:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463 to the API
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:16:20Z',
 'fuel_type': 'diesel',
 'id': '7ab6c094-4925-54cd-a193-7a20a3b2c51d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT04463',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 210147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-14',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-28 11:39:18 [auto1.be] INFO: Saving data for UT04463: {'auction_closing_time': 1774714580.0, 'created_time': 1773866701.354523, 'last_price_update_time': 1774697958.623193}
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT04463') HTTP/1.1" 204 0
2026-03-28 11:39:18 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1821 | hits on page: 40
2026-03-28 11:39:18 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-28 11:39:18 [auto1.be] INFO: Scrape type for BJ27729: 2
2026-03-28 11:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-28 11:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de489c1d-4dfa-5d64-b378-4f9773c807f9 with scrape type 2
2026-03-28 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de489c1d-4dfa-5d64-b378-4f9773c807f9 with scrape type 2
2026-03-28 11:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de489c1d-4dfa-5d64-b378-4f9773c807f9, identifier: BJ27729
2026-03-28 11:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-28 11:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-28 11:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729 to the API
2026-03-28 11:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:26Z',
 'fuel_type': 'petrol',
 'id': 'de489c1d-4dfa-5d64-b378-4f9773c807f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ27729',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 10113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-28 11:39:19 [auto1.be] INFO: Saving data for BJ27729: {'auction_closing_time': 1774716386.0, 'created_time': 1773866678.747124, 'last_price_update_time': 1774697959.112651}
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ27729') HTTP/1.1" 204 0
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-28 11:39:19 [auto1.be] INFO: Scrape type for KF81819: 2
2026-03-28 11:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-28 11:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62194af-a766-5e06-b7d1-4d103857dd73 with scrape type 2
2026-03-28 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c62194af-a766-5e06-b7d1-4d103857dd73 with scrape type 2
2026-03-28 11:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c62194af-a766-5e06-b7d1-4d103857dd73, identifier: KF81819
2026-03-28 11:39:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 11:39:19 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-28 11:39:19 [auto1.be] INFO: Scrape type for GC03502: 2
2026-03-28 11:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-28 11:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with scrape type 2
2026-03-28 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with scrape type 2
2026-03-28 11:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3, identifier: GC03502
2026-03-28 11:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-28 11:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-28 11:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819 to the API
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-28T16:19:53Z',
 'fuel_type': 'petrol',
 'id': 'c62194af-a766-5e06-b7d1-4d103857dd73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF81819',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 125165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-02',
 'seller_name': None,
 'title': 'Chrysler 300 C 2.7',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-28 11:39:19 [auto1.be] INFO: Saving data for KF81819: {'auction_closing_time': 1774714793.0, 'created_time': 1773301686.459703, 'last_price_update_time': 1774697959.633873}
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF81819') HTTP/1.1" 204 0
2026-03-28 11:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-28 11:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-28 11:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502 to the API
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:26:47Z',
 'fuel_type': 'petrol',
 'id': '123cbe69-4dfe-5185-bfd3-9ada7de4c9b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC03502',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 154692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-28 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Saving data for GC03502: {'auction_closing_time': 1774715207.0, 'created_time': 1773131891.522737, 'last_price_update_time': 1774697960.003559}
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC03502') HTTP/1.1" 204 0
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Scrape type for KP16038: 2
2026-03-28 11:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-28 11:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad01e60-ac17-529b-ab84-522576749a70 with scrape type 2
2026-03-28 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ad01e60-ac17-529b-ab84-522576749a70 with scrape type 2
2026-03-28 11:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ad01e60-ac17-529b-ab84-522576749a70, identifier: KP16038
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Scrape type for FC28385: 2
2026-03-28 11:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-28 11:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e066583-a6d5-54c4-9ace-e3e906348de6 with scrape type 2
2026-03-28 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e066583-a6d5-54c4-9ace-e3e906348de6 with scrape type 2
2026-03-28 11:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e066583-a6d5-54c4-9ace-e3e906348de6, identifier: FC28385
2026-03-28 11:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-28 11:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-28 11:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038 to the API
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:58Z',
 'fuel_type': 'diesel',
 'id': '6ad01e60-ac17-529b-ab84-522576749a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16038',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 157350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Saving data for KP16038: {'auction_closing_time': 1774715038.0, 'created_time': 1773693559.723935, 'last_price_update_time': 1774697960.504435}
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP16038') HTTP/1.1" 204 0
2026-03-28 11:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-28 11:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-28 11:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385 to the API
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:26Z',
 'fuel_type': 'petrol',
 'id': '5e066583-a6d5-54c4-9ace-e3e906348de6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC28385',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 208965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-07',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Saving data for FC28385: {'auction_closing_time': 1774713866.0, 'created_time': 1773134409.180453, 'last_price_update_time': 1774697960.777141}
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC28385') HTTP/1.1" 204 0
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Scrape type for PH64665: 2
2026-03-28 11:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-28 11:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be884f4-f70e-5d5b-8d2c-d41e539064fb with scrape type 2
2026-03-28 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be884f4-f70e-5d5b-8d2c-d41e539064fb with scrape type 2
2026-03-28 11:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9be884f4-f70e-5d5b-8d2c-d41e539064fb, identifier: PH64665
2026-03-28 11:39:20 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-28 11:39:20 [auto1.be] INFO: Scrape type for MD39375: 2
2026-03-28 11:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-28 11:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f213a5-7404-512c-bbab-565407f10070 with scrape type 2
2026-03-28 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f213a5-7404-512c-bbab-565407f10070 with scrape type 2
2026-03-28 11:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6f213a5-7404-512c-bbab-565407f10070, identifier: MD39375
2026-03-28 11:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-28 11:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-28 11:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665 to the API
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'diesel',
 'id': '9be884f4-f70e-5d5b-8d2c-d41e539064fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH64665',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 277375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-04',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-28 11:39:21 [auto1.be] INFO: Saving data for PH64665: {'auction_closing_time': 1774716172.0, 'created_time': 1773693510.93278, 'last_price_update_time': 1774697961.28443}
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH64665') HTTP/1.1" 204 0
2026-03-28 11:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-28 11:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-28 11:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375 to the API
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:57:57Z',
 'fuel_type': 'diesel',
 'id': 'c6f213a5-7404-512c-bbab-565407f10070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD39375',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 177128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2014}
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-28 11:39:21 [auto1.be] INFO: Saving data for MD39375: {'auction_closing_time': 1774717077.0, 'created_time': 1774611393.594095, 'last_price_update_time': 1774697961.554386}
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD39375') HTTP/1.1" 204 0
2026-03-28 11:39:21 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 11:39:21 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 11:39:21 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-28 11:39:21 [auto1.be] INFO: Scrape type for ZN66630: 2
2026-03-28 11:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-28 11:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a29ab3b-b179-569f-a52d-ca54419ea957 with scrape type 2
2026-03-28 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a29ab3b-b179-569f-a52d-ca54419ea957 with scrape type 2
2026-03-28 11:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a29ab3b-b179-569f-a52d-ca54419ea957, identifier: ZN66630
2026-03-28 11:39:21 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-28 11:39:21 [auto1.be] INFO: Scrape type for ZJ33794: 2
2026-03-28 11:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-28 11:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with scrape type 2
2026-03-28 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with scrape type 2
2026-03-28 11:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b774dfc-948d-53b0-a1a1-a400d054a6c0, identifier: ZJ33794
2026-03-28 11:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-28 11:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-28 11:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630 to the API
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:16:47Z',
 'fuel_type': 'petrol',
 'id': '7a29ab3b-b179-569f-a52d-ca54419ea957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN66630',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 115965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-28 11:39:22 [auto1.be] INFO: Saving data for ZN66630: {'auction_closing_time': 1774714607.0, 'created_time': 1774611391.457045, 'last_price_update_time': 1774697962.025787}
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN66630') HTTP/1.1" 204 0
2026-03-28 11:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-28 11:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-28 11:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794 to the API
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:32:41Z',
 'fuel_type': 'diesel',
 'id': '6b774dfc-948d-53b0-a1a1-a400d054a6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ33794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2015}
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-28 11:39:22 [auto1.be] INFO: Saving data for ZJ33794: {'auction_closing_time': 1774715561.0, 'created_time': 1773238108.059606, 'last_price_update_time': 1774697962.380508}
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ33794') HTTP/1.1" 204 0
2026-03-28 11:39:22 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 11:39:22 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-28 11:39:22 [auto1.be] INFO: Scrape type for GH94077: 2
2026-03-28 11:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-28 11:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with scrape type 2
2026-03-28 11:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with scrape type 2
2026-03-28 11:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 273cc2a8-9f22-54ab-bed4-684f509ae1d4, identifier: GH94077
2026-03-28 11:39:22 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-28 11:39:22 [auto1.be] INFO: Scrape type for KF50538: 2
2026-03-28 11:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-28 11:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with scrape type 2
2026-03-28 11:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with scrape type 2
2026-03-28 11:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6733d0f4-f06a-58a8-8654-5ebeee483ee0, identifier: KF50538
2026-03-28 11:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-28 11:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-28 11:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077 to the API
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:37:48Z',
 'fuel_type': 'diesel',
 'id': '273cc2a8-9f22-54ab-bed4-684f509ae1d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH94077',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 224435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'BMW 3er 335d xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2015}
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-28 11:39:22 [auto1.be] INFO: Saving data for GH94077: {'auction_closing_time': 1774715868.0, 'created_time': 1773693526.746469, 'last_price_update_time': 1774697962.95718}
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH94077') HTTP/1.1" 204 0
2026-03-28 11:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-28 11:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-28 11:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538 to the API
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:06Z',
 'fuel_type': 'diesel',
 'id': '6733d0f4-f06a-58a8-8654-5ebeee483ee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF50538',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 145675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-28 11:39:23 [auto1.be] INFO: Saving data for KF50538: {'auction_closing_time': 1774714686.0, 'created_time': 1773240138.017526, 'last_price_update_time': 1774697963.237616}
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF50538') HTTP/1.1" 204 0
2026-03-28 11:39:23 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-28 11:39:23 [auto1.be] INFO: Scrape type for SB45161: 2
2026-03-28 11:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-28 11:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with scrape type 2
2026-03-28 11:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with scrape type 2
2026-03-28 11:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6b4a665-3a4c-5f0f-aa51-c983852f4d46, identifier: SB45161
2026-03-28 11:39:23 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 11:39:23 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-28 11:39:23 [auto1.be] INFO: Scrape type for PM96543: 2
2026-03-28 11:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-28 11:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3094276f-f50f-5560-840c-9715111c4757 with scrape type 2
2026-03-28 11:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3094276f-f50f-5560-840c-9715111c4757 with scrape type 2
2026-03-28 11:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3094276f-f50f-5560-840c-9715111c4757, identifier: PM96543
2026-03-28 11:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-28 11:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-28 11:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161 to the API
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:25:17Z',
 'fuel_type': 'diesel',
 'id': 'c6b4a665-3a4c-5f0f-aa51-c983852f4d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB45161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 114238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d T 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': 'T 4Matic Exclusive',
 'year': 2018}
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-28 11:39:23 [auto1.be] INFO: Saving data for SB45161: {'auction_closing_time': 1774715117.0, 'created_time': 1773780008.614746, 'last_price_update_time': 1774697963.744756}
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB45161') HTTP/1.1" 204 0
2026-03-28 11:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-28 11:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-28 11:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543 to the API
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:17:08Z',
 'fuel_type': 'petrol',
 'id': '3094276f-f50f-5560-840c-9715111c4757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM96543',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 121557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2021}
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-28 11:39:24 [auto1.be] INFO: Saving data for PM96543: {'auction_closing_time': 1774714628.0, 'created_time': 1773132475.845034, 'last_price_update_time': 1774697964.037675}
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM96543') HTTP/1.1" 204 0
2026-03-28 11:39:24 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 11:39:24 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-28 11:39:24 [auto1.be] INFO: Scrape type for JJ10339: 2
2026-03-28 11:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-28 11:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81fff97d-7a98-5822-adca-eeab47b5c767 with scrape type 2
2026-03-28 11:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81fff97d-7a98-5822-adca-eeab47b5c767 with scrape type 2
2026-03-28 11:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 81fff97d-7a98-5822-adca-eeab47b5c767, identifier: JJ10339
2026-03-28 11:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:39:24 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 11:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-28 11:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-28 11:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339 to the API
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:57Z',
 'fuel_type': 'petrol',
 'id': '81fff97d-7a98-5822-adca-eeab47b5c767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ10339',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 52303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Suzuki SX4 1.4 BoosterJet Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2019}
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-28 11:39:24 [auto1.be] INFO: Saving data for JJ10339: {'auction_closing_time': 1774716117.0, 'created_time': 1773779728.658145, 'last_price_update_time': 1774697964.439606}
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ10339') HTTP/1.1" 204 0
2026-03-28 11:39:24 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-28 11:39:24 [auto1.be] INFO: Scrape type for BU90061: 2
2026-03-28 11:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-28 11:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c147655d-5598-5a29-851e-ac380e05905d with scrape type 2
2026-03-28 11:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c147655d-5598-5a29-851e-ac380e05905d with scrape type 2
2026-03-28 11:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c147655d-5598-5a29-851e-ac380e05905d, identifier: BU90061
2026-03-28 11:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-28 11:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-28 11:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061 to the API
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:33Z',
 'fuel_type': 'diesel',
 'id': 'c147655d-5598-5a29-851e-ac380e05905d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU90061',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 254780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-28 11:39:24 [auto1.be] INFO: Saving data for BU90061: {'auction_closing_time': 1774714953.0, 'created_time': 1773238342.478019, 'last_price_update_time': 1774697964.809481}
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU90061') HTTP/1.1" 204 0
2026-03-28 11:39:24 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 11:39:24 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 11:39:24 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-28 11:39:24 [auto1.be] INFO: Scrape type for KN88676: 2
2026-03-28 11:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-28 11:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35733f2-4263-517c-8003-1531b3a86137 with scrape type 2
2026-03-28 11:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35733f2-4263-517c-8003-1531b3a86137 with scrape type 2
2026-03-28 11:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b35733f2-4263-517c-8003-1531b3a86137, identifier: KN88676
2026-03-28 11:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-28 11:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-28 11:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676 to the API
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-28T16:33:14Z',
 'fuel_type': 'diesel',
 'id': 'b35733f2-4263-517c-8003-1531b3a86137',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN88676',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 206887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2013}
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-28 11:39:25 [auto1.be] INFO: Saving data for KN88676: {'auction_closing_time': 1774715594.0, 'created_time': 1773136045.972491, 'last_price_update_time': 1774697965.234414}
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KN88676') HTTP/1.1" 204 0
2026-03-28 11:39:25 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-28 11:39:25 [auto1.be] INFO: Scrape type for HW65369: 2
2026-03-28 11:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-28 11:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item babea493-d702-55d5-914b-4e328915b3d6 with scrape type 2
2026-03-28 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item babea493-d702-55d5-914b-4e328915b3d6 with scrape type 2
2026-03-28 11:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: babea493-d702-55d5-914b-4e328915b3d6, identifier: HW65369
2026-03-28 11:39:25 [auto1.be] INFO: Channel: 24h | Page: 45 | totalHits: 1821 | hits on page: 40
2026-03-28 11:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-28 11:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-28 11:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369 to the API
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:28:46Z',
 'fuel_type': 'hybrid',
 'id': 'babea493-d702-55d5-914b-4e328915b3d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW65369',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 77633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-04',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-28 11:39:25 [auto1.be] INFO: Saving data for HW65369: {'auction_closing_time': 1774715326.0, 'created_time': 1773136838.383482, 'last_price_update_time': 1774697965.697757}
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW65369') HTTP/1.1" 204 0
2026-03-28 11:39:25 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-28 11:39:25 [auto1.be] INFO: Scrape type for WG62431: 2
2026-03-28 11:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-28 11:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2958b0c5-2af7-5849-b74b-c3641fee5741 with scrape type 2
2026-03-28 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2958b0c5-2af7-5849-b74b-c3641fee5741 with scrape type 2
2026-03-28 11:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2958b0c5-2af7-5849-b74b-c3641fee5741, identifier: WG62431
2026-03-28 11:39:25 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-28 11:39:25 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-28 11:39:25 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 11:39:25 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY53837%27 HTTP/1.1" 200 None
2026-03-28 11:39:25 [auto1.be] INFO: Scrape type for NY53837: 2
2026-03-28 11:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837
2026-03-28 11:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with scrape type 2
2026-03-28 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with scrape type 2
2026-03-28 11:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c, identifier: NY53837
2026-03-28 11:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-28 11:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-28 11:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431 to the API
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:35Z',
 'fuel_type': 'petrol',
 'id': '2958b0c5-2af7-5849-b74b-c3641fee5741',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG62431',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 213486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-07',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-28 11:39:26 [auto1.be] INFO: Saving data for WG62431: {'auction_closing_time': 1774715915.0, 'created_time': 1774125510.73548, 'last_price_update_time': 1774697966.191516}
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG62431') HTTP/1.1" 204 0
2026-03-28 11:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837
2026-03-28 11:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837
2026-03-28 11:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837 to the API
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:08Z',
 'fuel_type': 'diesel',
 'id': 'b84c54f0-0bf8-5ed5-aeda-a55141a52b4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY53837',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 194633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-11',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L2H2 Premium Stop&Start',
 'transmission': 'manual',
 'trim': '335 L2H2 Premium Stop&Start',
 'year': 2020}
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY53837%27 HTTP/1.1" 200 None
2026-03-28 11:39:26 [auto1.be] INFO: Saving data for NY53837: {'auction_closing_time': 1774714688.0, 'created_time': 1774611395.944713, 'last_price_update_time': 1774697966.458684}
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY53837') HTTP/1.1" 204 0
2026-03-28 11:39:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:39:26 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-28 11:39:26 [auto1.be] INFO: Scrape type for UH14890: 2
2026-03-28 11:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-28 11:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 216895f9-3ae9-598d-b3cd-35726bb9190c with scrape type 2
2026-03-28 11:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 216895f9-3ae9-598d-b3cd-35726bb9190c with scrape type 2
2026-03-28 11:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 216895f9-3ae9-598d-b3cd-35726bb9190c, identifier: UH14890
2026-03-28 11:39:26 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 11:39:26 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-28 11:39:26 [auto1.be] INFO: Scrape type for JA34397: 2
2026-03-28 11:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-28 11:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb with scrape type 2
2026-03-28 11:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb with scrape type 2
2026-03-28 11:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0920a71-39f6-5dac-87cb-fb128e3d8cbb, identifier: JA34397
2026-03-28 11:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-28 11:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-28 11:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890 to the API
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:31:30Z',
 'fuel_type': 'petrol',
 'id': '216895f9-3ae9-598d-b3cd-35726bb9190c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14890',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 78304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-21',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-28 11:39:26 [auto1.be] INFO: Saving data for UH14890: {'auction_closing_time': 1774715490.0, 'created_time': 1773693525.425046, 'last_price_update_time': 1774697966.95878}
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UH14890') HTTP/1.1" 204 0
2026-03-28 11:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-28 11:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-28 11:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397 to the API
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:51Z',
 'fuel_type': 'petrol',
 'id': 'c0920a71-39f6-5dac-87cb-fb128e3d8cbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA34397',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 126696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Saving data for JA34397: {'auction_closing_time': 1774716411.0, 'created_time': 1774611399.55852, 'last_price_update_time': 1774697967.231661}
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JA34397') HTTP/1.1" 204 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for SC73086: 2
2026-03-28 11:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-28 11:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b44c9a68-462c-59cc-842a-a42a634a4c4d with scrape type 2
2026-03-28 11:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b44c9a68-462c-59cc-842a-a42a634a4c4d with scrape type 2
2026-03-28 11:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b44c9a68-462c-59cc-842a-a42a634a4c4d, identifier: SC73086
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV40639%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for FV40639: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU84298%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for JU84298: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23353%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for BC23353: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF18972%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Scrape type for JF18972: 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 11:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-28 11:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-28 11:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086 to the API
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:28Z',
 'fuel_type': 'petrol',
 'id': 'b44c9a68-462c-59cc-842a-a42a634a4c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC73086',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 136155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-19',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2014}
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-28 11:39:27 [auto1.be] INFO: Saving data for SC73086: {'auction_closing_time': 1774713928.0, 'created_time': 1774298364.450341, 'last_price_update_time': 1774697967.836473}
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC73086') HTTP/1.1" 204 0
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-28 11:39:27 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 11:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:39:28 [auto1.be] INFO: Channel: 24h | Page: 46 | totalHits: 1821 | hits on page: 21
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA37935%27 HTTP/1.1" 200 None
2026-03-28 11:39:28 [auto1.be] INFO: Scrape type for YA37935: 0
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-28 11:39:28 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ45584%27 HTTP/1.1" 200 None
2026-03-28 11:39:28 [auto1.be] INFO: Scrape type for JJ45584: 0
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-28 11:39:28 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-28 11:39:28 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-28 11:39:28 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-28 11:39:28 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-28 11:39:29 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-28 11:39:29 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-28 11:39:29 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-28 11:39:29 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-28 11:39:29 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-28 11:39:29 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-28 11:39:29 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-28 11:39:29 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 11:39:29 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 11:39:29 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-28 11:39:29 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-28 11:39:29 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-28 11:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:39:29 [auto1.be] INFO: Channel: 24h | Page: 47 | totalHits: 1821 | hits on page: 0
2026-03-28 11:39:29 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 11:39:29 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-28 11:39:29 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 11, <ScrapeType.BATCH_SKIPPED: 5>: 21}
2026-03-28 11:39:30 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (237 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-28T11_35_00.jl
2026-03-28 11:39:30 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 989991,
 'downloader/request_count': 572,
 'downloader/request_method_count/GET': 523,
 'downloader/request_method_count/POST': 49,
 'downloader/response_bytes': 251713632,
 'downloader/response_count': 572,
 'downloader/response_status_count/200': 572,
 'dupefilter/filtered': 20,
 'elapsed_time_seconds': 263.307437,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 11, 39, 30, 29194, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 237,
 'log_count/DEBUG': 7052,
 'log_count/INFO': 7799,
 'memusage/max': 198139904,
 'memusage/startup': 147734528,
 'photo_download_count': 403,
 'request_depth_max': 50,
 'response_received_count': 169,
 'scheduler/dequeued': 572,
 'scheduler/dequeued/memory': 572,
 'scheduler/enqueued': 572,
 'scheduler/enqueued/memory': 572,
 'scrape_type/batch_skipped': 943,
 'scrape_type/new': 59,
 'scrape_type/price_update': 178,
 'scrape_type/skipped': 661,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 169,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.6441014097761038,
 'scrapy-zyte-api/mean_response_seconds': 2.7018585114756375,
 'scrapy-zyte-api/processed': 169,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 169,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 168,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 169,
 'scrapy-zyte-api/request_args/httpRequestBody': 49,
 'scrapy-zyte-api/request_args/httpRequestMethod': 49,
 'scrapy-zyte-api/request_args/httpResponseBody': 169,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 169,
 'scrapy-zyte-api/request_args/sessionContext': 169,
 'scrapy-zyte-api/request_args/url': 169,
 'scrapy-zyte-api/status_codes/200': 169,
 'scrapy-zyte-api/success': 169,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1861,
 'source/total_available': 1821,
 'start_time': datetime.datetime(2026, 3, 28, 11, 35, 6, 721757, tzinfo=datetime.timezone.utc)}
2026-03-28 11:39:30 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 11:39:30 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5cd35d02d0>
2026-03-28 11:39:30 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f5cd3437c10>