2026-03-28 20:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 20:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 20:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-28 20:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 20:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 20:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 20:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 20:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 20:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: a2e1ec7c9b393b59
2026-03-28 20:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 20:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-28T20_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 20:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 20:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 20:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 20:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 20:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 20:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 20:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 20:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-28 20:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 20:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 20:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 20:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 20:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 20:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 20:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 20:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 20:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 20:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 20:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 20:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 20:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 20:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 20:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 20:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 20:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 20:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 20:35:17 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Scrape type for ML65590: 2
2026-03-28 20:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590
2026-03-28 20:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05db3c68-37cd-513b-995b-87034a44aa05 with scrape type 2
2026-03-28 20:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05db3c68-37cd-513b-995b-87034a44aa05 with scrape type 2
2026-03-28 20:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 05db3c68-37cd-513b-995b-87034a44aa05, identifier: ML65590
2026-03-28 20:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 20:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 20:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590
2026-03-28 20:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 05db3c68-37cd-513b-995b-87034a44aa05 with identifier: ML65590 to the API
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'diesel',
 'id': '05db3c68-37cd-513b-995b-87034a44aa05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML65590',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 64891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Saving data for ML65590: {'auction_closing_time': 1774882978.0, 'created_time': 1773384529.883265, 'last_price_update_time': 1774730117.822658}
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML65590') HTTP/1.1" 204 0
2026-03-28 20:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Scrape type for YU22338: 1
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Scrape type for SW98803: 1
2026-03-28 20:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Scrape type for LP50838: 1
2026-03-28 20:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Scrape type for MW29844: 1
2026-03-28 20:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:17 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-28 20:35:17 [auto1.be] INFO: Scrape type for FH45476: 2
2026-03-28 20:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476
2026-03-28 20:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with scrape type 2
2026-03-28 20:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with scrape type 2
2026-03-28 20:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74, identifier: FH45476
2026-03-28 20:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476
2026-03-28 20:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476
2026-03-28 20:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74 with identifier: FH45476 to the API
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:20:45Z',
 'fuel_type': 'diesel',
 'id': '2bc37d12-66ae-5dfd-8f5a-5b4e9e86dc74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH45476',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 120107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L1 Premium',
 'transmission': 'manual',
 'trim': 'L1 Premium',
 'year': 2019}
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Saving data for FH45476: {'auction_closing_time': 1774884045.0, 'created_time': 1774002088.816671, 'last_price_update_time': 1774730118.401537}
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH45476') HTTP/1.1" 204 0
2026-03-28 20:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for NP55006: 1
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for DP40243: 1
2026-03-28 20:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for BR63185: 1
2026-03-28 20:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for AK19302: 1
2026-03-28 20:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for NR82041: 1
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 20:35:18 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-28 20:35:18 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-28 20:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW29844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP55006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU22338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW98803/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP50838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP40243/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR63185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:20 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-28 20:35:20 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/YU22338/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 20:35:20 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-28 20:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR82041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK19302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW29844> (referer: https://www.auto1.com/v1/car-details-view/MW29844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844
2026-03-28 20:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef602e6-fec7-5299-8276-c04dd95a404d with scrape type 1
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ef602e6-fec7-5299-8276-c04dd95a404d
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_930cf08ee75a9b2cf6709eae7542a43e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_930cf08ee75a9b2cf6709eae7542a43e.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_a6358eee922839801749224d9bf727ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_a6358eee922839801749224d9bf727ab.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_32ca7d5dc8b6041c747ae27127531065.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_32ca7d5dc8b6041c747ae27127531065.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_6162f4557ad9ff80c38bec48b98b1112.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_6162f4557ad9ff80c38bec48b98b1112.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_ef83344bbd8ad3ee2b6f823dedf9b565.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_ef83344bbd8ad3ee2b6f823dedf9b565.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_ec271d4bc597d025f78a5a64f36182bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_ec271d4bc597d025f78a5a64f36182bb.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_f3c49504d405c0c62d3e58b40be19b06.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_f3c49504d405c0c62d3e58b40be19b06.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_c38da38569af1e7ce1ecbfd32677ba8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_c38da38569af1e7ce1ecbfd32677ba8f.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_7386d1b278e68e6deb9e84f24708d368.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_7386d1b278e68e6deb9e84f24708d368.jpg already downloaded
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F0b%252Faf0b739dde59c676dbafdb05782309c5%252Fpa%252FMW29844_986db374748f00e0f4ed72501a873e70.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_986db374748f00e0f4ed72501a873e70.jpg already downloaded
2026-03-28 20:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ef602e6-fec7-5299-8276-c04dd95a404d, identifier: MW29844
2026-03-28 20:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844
2026-03-28 20:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 20:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 20:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844
2026-03-28 20:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ef602e6-fec7-5299-8276-c04dd95a404d with identifier: MW29844 to the API
2026-03-28 20:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW29844>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:17Z',
 'fuel_type': 'petrol',
 'id': '6ef602e6-fec7-5299-8276-c04dd95a404d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW29844',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'BMW',
 'model': '1er',
 'odometer': 168348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_930cf08ee75a9b2cf6709eae7542a43e.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_a6358eee922839801749224d9bf727ab.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_32ca7d5dc8b6041c747ae27127531065.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_6162f4557ad9ff80c38bec48b98b1112.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_ef83344bbd8ad3ee2b6f823dedf9b565.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_ec271d4bc597d025f78a5a64f36182bb.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_f3c49504d405c0c62d3e58b40be19b06.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_c38da38569af1e7ce1ecbfd32677ba8f.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_7386d1b278e68e6deb9e84f24708d368.jpg',
                'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_986db374748f00e0f4ed72501a873e70.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903128,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_930cf08ee75a9b2cf6709eae7542a43e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_a6358eee922839801749224d9bf727ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_32ca7d5dc8b6041c747ae27127531065.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_6162f4557ad9ff80c38bec48b98b1112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_ef83344bbd8ad3ee2b6f823dedf9b565.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2885590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_ec271d4bc597d025f78a5a64f36182bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_f3c49504d405c0c62d3e58b40be19b06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_c38da38569af1e7ce1ecbfd32677ba8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_7386d1b278e68e6deb9e84f24708d368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ef602e6-fec7-5299-8276-c04dd95a404d/6ef602e6-fec7-5299-8276-c04dd95a404d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/0b/af0b739dde59c676dbafdb05782309c5/pa/MW29844_986db374748f00e0f4ed72501a873e70.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-28 20:35:22 [auto1.be] INFO: Saving data for MW29844: {'created_time': 1774730122.740303, 'last_price_update_time': 1774730122.740319, 'auction_closing_time': 1774883957.0}
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW29844') HTTP/1.1" 204 0
2026-03-28 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP50838> (referer: https://www.auto1.com/v1/car-details-view/LP50838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP55006> (referer: https://www.auto1.com/v1/car-details-view/NP55006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW98803> (referer: https://www.auto1.com/v1/car-details-view/SW98803/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU22338> (referer: https://www.auto1.com/v1/car-details-view/YU22338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP40243> (referer: https://www.auto1.com/v1/car-details-view/DP40243/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR63185> (referer: https://www.auto1.com/v1/car-details-view/BR63185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838
2026-03-28 20:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef966229-e609-529e-b6e0-773252aa68c3 with scrape type 1
2026-03-28 20:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef966229-e609-529e-b6e0-773252aa68c3
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_015311b385354f8b2a4315ab66128cb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_015311b385354f8b2a4315ab66128cb6.jpg already downloaded
2026-03-28 20:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_c01373c82dcdc8cfa34511709aadcb3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_c01373c82dcdc8cfa34511709aadcb3f.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_1a22be0bca1f76ed5c9a449b1d983861.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_1a22be0bca1f76ed5c9a449b1d983861.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_190952c1904b337f54071216d630cbe6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_190952c1904b337f54071216d630cbe6.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_ebfbaaf8ca48280673d167fe8743fdae.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_ebfbaaf8ca48280673d167fe8743fdae.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_bf8d276404a05260841321c283143415.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_bf8d276404a05260841321c283143415.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_782ab8bc16c3b771647018e09e17b09f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_782ab8bc16c3b771647018e09e17b09f.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_c5103bbbfc35991230b0749b59397810.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_c5103bbbfc35991230b0749b59397810.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_6d26d7b69f580aead0c197b1f000607c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_6d26d7b69f580aead0c197b1f000607c.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Faf%252Fbbafbe30c9aed300f447ab7b86ed40b8%252Fpa%252FLP50838_250088ea8adcbb5351411f2cb950298f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_250088ea8adcbb5351411f2cb950298f.jpg already downloaded
2026-03-28 20:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef966229-e609-529e-b6e0-773252aa68c3, identifier: LP50838
2026-03-28 20:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006
2026-03-28 20:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70dbc77-ea9e-553a-94c2-117cbcf57417 with scrape type 1
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b70dbc77-ea9e-553a-94c2-117cbcf57417
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_670a47534f2a3f64d6692471b1e4e352.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_670a47534f2a3f64d6692471b1e4e352.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_74fa2fc39ad4c9c739e2ab43af91a899.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_74fa2fc39ad4c9c739e2ab43af91a899.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_0d409f8612cde24dfd41069544981b5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_0d409f8612cde24dfd41069544981b5d.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_ed25ac470f354893115adaf64f2f5dd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_ed25ac470f354893115adaf64f2f5dd8.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_3f918bbd8a43ba36e33c7f81fed46373.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_3f918bbd8a43ba36e33c7f81fed46373.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_cbd8cfac196b526820a289f46846df72.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_cbd8cfac196b526820a289f46846df72.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_1fbe0de127dadc8c4b89d8edccf019d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_1fbe0de127dadc8c4b89d8edccf019d7.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_2ce3bd7dac7f4dd392bcd9534af49524.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_2ce3bd7dac7f4dd392bcd9534af49524.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_b687b1f37276a1521aac46326f26615e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_b687b1f37276a1521aac46326f26615e.jpg already downloaded
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F4c%252F7d4ce1fe257668cedc289ac37521e1ce%252Fpa%252FNP55006_4ca14fd2d299a61ab4f2246de2feace3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_4ca14fd2d299a61ab4f2246de2feace3.jpg already downloaded
2026-03-28 20:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b70dbc77-ea9e-553a-94c2-117cbcf57417, identifier: NP55006
2026-03-28 20:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838
2026-03-28 20:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838
2026-03-28 20:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef966229-e609-529e-b6e0-773252aa68c3 with identifier: LP50838 to the API
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP50838>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:13Z',
 'fuel_type': 'diesel',
 'id': 'ef966229-e609-529e-b6e0-773252aa68c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP50838',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 130522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_015311b385354f8b2a4315ab66128cb6.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_c01373c82dcdc8cfa34511709aadcb3f.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_1a22be0bca1f76ed5c9a449b1d983861.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_190952c1904b337f54071216d630cbe6.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_ebfbaaf8ca48280673d167fe8743fdae.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_bf8d276404a05260841321c283143415.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_782ab8bc16c3b771647018e09e17b09f.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_c5103bbbfc35991230b0749b59397810.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_6d26d7b69f580aead0c197b1f000607c.jpg',
                'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_250088ea8adcbb5351411f2cb950298f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_015311b385354f8b2a4315ab66128cb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_c01373c82dcdc8cfa34511709aadcb3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_1a22be0bca1f76ed5c9a449b1d983861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_190952c1904b337f54071216d630cbe6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_ebfbaaf8ca48280673d167fe8743fdae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_bf8d276404a05260841321c283143415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_782ab8bc16c3b771647018e09e17b09f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_c5103bbbfc35991230b0749b59397810.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852223,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_6d26d7b69f580aead0c197b1f000607c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef966229-e609-529e-b6e0-773252aa68c3/ef966229-e609-529e-b6e0-773252aa68c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/af/bbafbe30c9aed300f447ab7b86ed40b8/pa/LP50838_250088ea8adcbb5351411f2cb950298f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-28 20:35:23 [auto1.be] INFO: Saving data for LP50838: {'created_time': 1774730123.86855, 'last_price_update_time': 1774730123.868565, 'auction_closing_time': 1774884493.0}
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP50838') HTTP/1.1" 204 0
2026-03-28 20:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006
2026-03-28 20:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006
2026-03-28 20:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b70dbc77-ea9e-553a-94c2-117cbcf57417 with identifier: NP55006 to the API
2026-03-28 20:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NP55006>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:50:37Z',
 'fuel_type': 'diesel',
 'id': 'b70dbc77-ea9e-553a-94c2-117cbcf57417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP55006',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 57968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_670a47534f2a3f64d6692471b1e4e352.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_74fa2fc39ad4c9c739e2ab43af91a899.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_0d409f8612cde24dfd41069544981b5d.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_ed25ac470f354893115adaf64f2f5dd8.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_3f918bbd8a43ba36e33c7f81fed46373.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_cbd8cfac196b526820a289f46846df72.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_1fbe0de127dadc8c4b89d8edccf019d7.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_2ce3bd7dac7f4dd392bcd9534af49524.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_b687b1f37276a1521aac46326f26615e.jpg',
                'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_4ca14fd2d299a61ab4f2246de2feace3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_670a47534f2a3f64d6692471b1e4e352.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_74fa2fc39ad4c9c739e2ab43af91a899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_0d409f8612cde24dfd41069544981b5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_ed25ac470f354893115adaf64f2f5dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_3f918bbd8a43ba36e33c7f81fed46373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_cbd8cfac196b526820a289f46846df72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_1fbe0de127dadc8c4b89d8edccf019d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_2ce3bd7dac7f4dd392bcd9534af49524.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_b687b1f37276a1521aac46326f26615e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70dbc77-ea9e-553a-94c2-117cbcf57417/b70dbc77-ea9e-553a-94c2-117cbcf57417_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2384307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/4c/7d4ce1fe257668cedc289ac37521e1ce/pa/NP55006_4ca14fd2d299a61ab4f2246de2feace3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L3',
 'transmission': 'automatic',
 'trim': 'Allure L3',
 'year': 2021}
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [auto1.be] INFO: Saving data for NP55006: {'created_time': 1774730124.180093, 'last_price_update_time': 1774730124.180108, 'auction_closing_time': 1774885837.0}
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP55006') HTTP/1.1" 204 0
2026-03-28 20:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803
2026-03-28 20:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with scrape type 1
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_30dd15a9f1e15d8e1cff8095a1950299.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_30dd15a9f1e15d8e1cff8095a1950299.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_024366ba908c3aadae2800191a49a340.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_024366ba908c3aadae2800191a49a340.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_f38b9b13453890fea95fe638c58620a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_f38b9b13453890fea95fe638c58620a1.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_c3cf6f40a0ce6f008a723f46f8826016.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_c3cf6f40a0ce6f008a723f46f8826016.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_d594b3cba7c4b71f027c910c4e791b9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_d594b3cba7c4b71f027c910c4e791b9f.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_eb4e602b0ddcf48a7a9d0525eb686986.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_eb4e602b0ddcf48a7a9d0525eb686986.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_87ca7400bd52a7122d92399e45e3a5f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_87ca7400bd52a7122d92399e45e3a5f7.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_4f6200b5734d2cb592ce3d8c7456b9b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_4f6200b5734d2cb592ce3d8c7456b9b8.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_6a4a5c267157d0f829443d2cf5aa136a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_6a4a5c267157d0f829443d2cf5aa136a.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F5f%252F9f5f8137932158eeb73e0a9856b37303%252Fpa%252FSW98803_d0c38eba9c84c84028b9c50240f40d7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_d0c38eba9c84c84028b9c50240f40d7b.jpg already downloaded
2026-03-28 20:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4, identifier: SW98803
2026-03-28 20:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338
2026-03-28 20:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef0f2788-a007-5a3e-be0d-6826cf341be2 with scrape type 1
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef0f2788-a007-5a3e-be0d-6826cf341be2
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_1a29331e2b8a3d6e5cc9f0d0eaf91a17.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_1a29331e2b8a3d6e5cc9f0d0eaf91a17.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_b0b2b62f8efab45ca28c98cd2d2fa5dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_b0b2b62f8efab45ca28c98cd2d2fa5dc.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_b31adac673b4365a3a0c55198ff90ec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_b31adac673b4365a3a0c55198ff90ec8.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_651a448f228c645f74b2d731d695e88a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_651a448f228c645f74b2d731d695e88a.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_143acb69db2e97fa4288b0f0241940bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_143acb69db2e97fa4288b0f0241940bd.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_152d9c07c4d5c2f2bc34ec38803ed9ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_152d9c07c4d5c2f2bc34ec38803ed9ec.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_88f6720a6d5b5a705256331b1a1ff2f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_88f6720a6d5b5a705256331b1a1ff2f1.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_5a893683e9abdefd182f1aff826a92a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_5a893683e9abdefd182f1aff826a92a2.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_38eeee9623c4b43c3f5a2749cf48490f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_38eeee9623c4b43c3f5a2749cf48490f.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F6c%252Fe46ca290451504f551964f8b15d8fca7%252Fpa%252FYU22338_f0349cdea91c2d0f150becc0ef38446b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_f0349cdea91c2d0f150becc0ef38446b.jpg already downloaded
2026-03-28 20:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef0f2788-a007-5a3e-be0d-6826cf341be2, identifier: YU22338
2026-03-28 20:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243
2026-03-28 20:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8121c96f-5838-51e1-b6df-06eb6aee6b9a with scrape type 1
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8121c96f-5838-51e1-b6df-06eb6aee6b9a
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F1c%252F781cc1be8483c75d9b8fd9d0a55f9f0d%252Fpa%252FDP40243_898f243646577af0fe697122cd13e02e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_898f243646577af0fe697122cd13e02e.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F1c%252F781cc1be8483c75d9b8fd9d0a55f9f0d%252Fpa%252FDP40243_99d06933f2ef2a7f76362f0345dc079c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_99d06933f2ef2a7f76362f0345dc079c.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F1c%252F781cc1be8483c75d9b8fd9d0a55f9f0d%252Fpa%252FDP40243_976dc661c6e651ff53766fe4dd0b0e19.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_976dc661c6e651ff53766fe4dd0b0e19.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F1c%252F781cc1be8483c75d9b8fd9d0a55f9f0d%252Fpa%252FDP40243_4fc303b393788b9acb6e8c6956d6d7ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_4fc303b393788b9acb6e8c6956d6d7ea.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F1c%252F781cc1be8483c75d9b8fd9d0a55f9f0d%252Fpa%252FDP40243_339826a95e250831eb9114a6923e3c1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_339826a95e250831eb9114a6923e3c1a.jpg already downloaded
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F1c%252F781cc1be8483c75d9b8fd9d0a55f9f0d%252Fpa%252FDP40243_acf1616ae2b826c7501efb578739ba03.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_acf1616ae2b826c7501efb578739ba03.jpg already downloaded
2026-03-28 20:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8121c96f-5838-51e1-b6df-06eb6aee6b9a, identifier: DP40243
2026-03-28 20:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803
2026-03-28 20:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803
2026-03-28 20:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ab6483d-3294-57fe-8f2e-fa50f9aa40d4 with identifier: SW98803 to the API
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW98803>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.2L',
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:06:01Z',
 'fuel_type': 'diesel',
 'id': '1ab6483d-3294-57fe-8f2e-fa50f9aa40d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW98803',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 136811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_30dd15a9f1e15d8e1cff8095a1950299.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_024366ba908c3aadae2800191a49a340.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_f38b9b13453890fea95fe638c58620a1.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_c3cf6f40a0ce6f008a723f46f8826016.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_d594b3cba7c4b71f027c910c4e791b9f.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_eb4e602b0ddcf48a7a9d0525eb686986.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_87ca7400bd52a7122d92399e45e3a5f7.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_4f6200b5734d2cb592ce3d8c7456b9b8.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_6a4a5c267157d0f829443d2cf5aa136a.jpg',
                'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_d0c38eba9c84c84028b9c50240f40d7b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_30dd15a9f1e15d8e1cff8095a1950299.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_024366ba908c3aadae2800191a49a340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_f38b9b13453890fea95fe638c58620a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_c3cf6f40a0ce6f008a723f46f8826016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_d594b3cba7c4b71f027c910c4e791b9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_eb4e602b0ddcf48a7a9d0525eb686986.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_87ca7400bd52a7122d92399e45e3a5f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_4f6200b5734d2cb592ce3d8c7456b9b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2411377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_6a4a5c267157d0f829443d2cf5aa136a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab6483d-3294-57fe-8f2e-fa50f9aa40d4/1ab6483d-3294-57fe-8f2e-fa50f9aa40d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/5f/9f5f8137932158eeb73e0a9856b37303/pa/SW98803_d0c38eba9c84c84028b9c50240f40d7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Korando 2.2 TD Sapphire 4x4',
 'transmission': 'manual',
 'trim': 'Sapphire 4x4',
 'year': 2017}
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-28 20:35:25 [auto1.be] INFO: Saving data for SW98803: {'created_time': 1774730125.361688, 'last_price_update_time': 1774730125.361701, 'auction_closing_time': 1774883161.0}
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW98803') HTTP/1.1" 204 0
2026-03-28 20:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 20:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338
2026-03-28 20:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef0f2788-a007-5a3e-be0d-6826cf341be2 with identifier: YU22338 to the API
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU22338>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:23:08Z',
 'fuel_type': 'petrol',
 'id': 'ef0f2788-a007-5a3e-be0d-6826cf341be2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU22338',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 18940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_1a29331e2b8a3d6e5cc9f0d0eaf91a17.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_b0b2b62f8efab45ca28c98cd2d2fa5dc.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_b31adac673b4365a3a0c55198ff90ec8.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_651a448f228c645f74b2d731d695e88a.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_143acb69db2e97fa4288b0f0241940bd.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_152d9c07c4d5c2f2bc34ec38803ed9ec.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_88f6720a6d5b5a705256331b1a1ff2f1.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_5a893683e9abdefd182f1aff826a92a2.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_38eeee9623c4b43c3f5a2749cf48490f.jpg',
                'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_f0349cdea91c2d0f150becc0ef38446b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_1a29331e2b8a3d6e5cc9f0d0eaf91a17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_b0b2b62f8efab45ca28c98cd2d2fa5dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517771,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_b31adac673b4365a3a0c55198ff90ec8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2297270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_651a448f228c645f74b2d731d695e88a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_143acb69db2e97fa4288b0f0241940bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_152d9c07c4d5c2f2bc34ec38803ed9ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_88f6720a6d5b5a705256331b1a1ff2f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2651432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_5a893683e9abdefd182f1aff826a92a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_38eeee9623c4b43c3f5a2749cf48490f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef0f2788-a007-5a3e-be0d-6826cf341be2/ef0f2788-a007-5a3e-be0d-6826cf341be2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/6c/e46ca290451504f551964f8b15d8fca7/pa/YU22338_f0349cdea91c2d0f150becc0ef38446b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-28 20:35:25 [auto1.be] INFO: Saving data for YU22338: {'created_time': 1774730125.842692, 'last_price_update_time': 1774730125.842705, 'auction_closing_time': 1774884188.0}
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU22338') HTTP/1.1" 204 0
2026-03-28 20:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243
2026-03-28 20:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243
2026-03-28 20:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8121c96f-5838-51e1-b6df-06eb6aee6b9a with identifier: DP40243 to the API
2026-03-28 20:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP40243>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:43:34Z',
 'fuel_type': 'diesel',
 'id': '8121c96f-5838-51e1-b6df-06eb6aee6b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP40243',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 334004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_898f243646577af0fe697122cd13e02e.jpg',
                'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_99d06933f2ef2a7f76362f0345dc079c.jpg',
                'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_976dc661c6e651ff53766fe4dd0b0e19.jpg',
                'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_4fc303b393788b9acb6e8c6956d6d7ea.jpg',
                'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_339826a95e250831eb9114a6923e3c1a.jpg',
                'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_acf1616ae2b826c7501efb578739ba03.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8121c96f-5838-51e1-b6df-06eb6aee6b9a/8121c96f-5838-51e1-b6df-06eb6aee6b9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_898f243646577af0fe697122cd13e02e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8121c96f-5838-51e1-b6df-06eb6aee6b9a/8121c96f-5838-51e1-b6df-06eb6aee6b9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_99d06933f2ef2a7f76362f0345dc079c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8121c96f-5838-51e1-b6df-06eb6aee6b9a/8121c96f-5838-51e1-b6df-06eb6aee6b9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_976dc661c6e651ff53766fe4dd0b0e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8121c96f-5838-51e1-b6df-06eb6aee6b9a/8121c96f-5838-51e1-b6df-06eb6aee6b9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_4fc303b393788b9acb6e8c6956d6d7ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8121c96f-5838-51e1-b6df-06eb6aee6b9a/8121c96f-5838-51e1-b6df-06eb6aee6b9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_339826a95e250831eb9114a6923e3c1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8121c96f-5838-51e1-b6df-06eb6aee6b9a/8121c96f-5838-51e1-b6df-06eb6aee6b9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/1c/781cc1be8483c75d9b8fd9d0a55f9f0d/pa/DP40243_acf1616ae2b826c7501efb578739ba03.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Saving data for DP40243: {'created_time': 1774730126.172038, 'last_price_update_time': 1774730126.172049, 'auction_closing_time': 1774885414.0}
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP40243') HTTP/1.1" 204 0
2026-03-28 20:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR82041> (referer: https://www.auto1.com/v1/car-details-view/NR82041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185
2026-03-28 20:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458ef8a1-c528-5088-a34d-7649fd7a2144 with scrape type 1
2026-03-28 20:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 458ef8a1-c528-5088-a34d-7649fd7a2144
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd2%252Ff0d23d7556271fbe23b37ea0315b2d39%252Fpa%252FBR63185_20341bea42d0628b7e837f9fe3010c78.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_20341bea42d0628b7e837f9fe3010c78.jpg already downloaded
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd2%252Ff0d23d7556271fbe23b37ea0315b2d39%252Fpa%252FBR63185_07853c81ed3338c1947683a2281fb6ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_07853c81ed3338c1947683a2281fb6ec.jpg already downloaded
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd2%252Ff0d23d7556271fbe23b37ea0315b2d39%252Fpa%252FBR63185_cb39be5f4f33e5e435d5a3d2efa0c47d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_cb39be5f4f33e5e435d5a3d2efa0c47d.jpg already downloaded
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd2%252Ff0d23d7556271fbe23b37ea0315b2d39%252Fpa%252FBR63185_08bc06bdbc68dde50b0f0edee60700aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_08bc06bdbc68dde50b0f0edee60700aa.jpg already downloaded
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd2%252Ff0d23d7556271fbe23b37ea0315b2d39%252Fpa%252FBR63185_9c892f79f6f369816715a22f83fa4c96.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_9c892f79f6f369816715a22f83fa4c96.jpg already downloaded
2026-03-28 20:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 458ef8a1-c528-5088-a34d-7649fd7a2144, identifier: BR63185
2026-03-28 20:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185
2026-03-28 20:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185
2026-03-28 20:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 458ef8a1-c528-5088-a34d-7649fd7a2144 with identifier: BR63185 to the API
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BR63185>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': '458ef8a1-c528-5088-a34d-7649fd7a2144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR63185',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 234607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_20341bea42d0628b7e837f9fe3010c78.jpg',
                'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_07853c81ed3338c1947683a2281fb6ec.jpg',
                'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_cb39be5f4f33e5e435d5a3d2efa0c47d.jpg',
                'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_08bc06bdbc68dde50b0f0edee60700aa.jpg',
                'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_9c892f79f6f369816715a22f83fa4c96.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458ef8a1-c528-5088-a34d-7649fd7a2144/458ef8a1-c528-5088-a34d-7649fd7a2144_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_20341bea42d0628b7e837f9fe3010c78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458ef8a1-c528-5088-a34d-7649fd7a2144/458ef8a1-c528-5088-a34d-7649fd7a2144_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_07853c81ed3338c1947683a2281fb6ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458ef8a1-c528-5088-a34d-7649fd7a2144/458ef8a1-c528-5088-a34d-7649fd7a2144_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_cb39be5f4f33e5e435d5a3d2efa0c47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458ef8a1-c528-5088-a34d-7649fd7a2144/458ef8a1-c528-5088-a34d-7649fd7a2144_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_08bc06bdbc68dde50b0f0edee60700aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_458ef8a1-c528-5088-a34d-7649fd7a2144/458ef8a1-c528-5088-a34d-7649fd7a2144_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/d2/f0d23d7556271fbe23b37ea0315b2d39/pa/BR63185_9c892f79f6f369816715a22f83fa4c96.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Saving data for BR63185: {'created_time': 1774730126.792845, 'last_price_update_time': 1774730126.792859, 'auction_closing_time': 1774882938.0}
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR63185') HTTP/1.1" 204 0
2026-03-28 20:35:26 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 20:35:26 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-28 20:35:26 [auto1.be] INFO: Scrape type for HW95173: 2
2026-03-28 20:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-28 20:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with scrape type 2
2026-03-28 20:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with scrape type 2
2026-03-28 20:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa, identifier: HW95173
2026-03-28 20:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-28 20:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-28 20:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173 to the API
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:33Z',
 'fuel_type': 'petrol',
 'id': '0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW95173',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 258602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-12',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2011}
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [auto1.be] INFO: Saving data for HW95173: {'auction_closing_time': 1774885293.0, 'created_time': 1774524987.687508, 'last_price_update_time': 1774730127.331567}
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW95173') HTTP/1.1" 204 0
2026-03-28 20:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041
2026-03-28 20:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55094067-9dae-5906-9e44-829836aca38b with scrape type 1
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55094067-9dae-5906-9e44-829836aca38b
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_02ec5f0aa8f0da96c34d366313d22d7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_02ec5f0aa8f0da96c34d366313d22d7d.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_bda3f33716d93d5c15426898f223a5e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_bda3f33716d93d5c15426898f223a5e0.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_c295c48a34db14cddc37522c5639b09f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_c295c48a34db14cddc37522c5639b09f.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_ecd820da7519aa0d1c7d46ebbbce89a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_ecd820da7519aa0d1c7d46ebbbce89a7.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_1c3210261c3547ec128ea2ef05306b44.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_1c3210261c3547ec128ea2ef05306b44.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_9eddab043fdf29d636e3ff121ffcf3b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_9eddab043fdf29d636e3ff121ffcf3b1.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_72a55c275736d4127a65e98e48bcfefd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_72a55c275736d4127a65e98e48bcfefd.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_da4832a4aaa36ee9967bbb519732fb69.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_da4832a4aaa36ee9967bbb519732fb69.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_07cb5a3282896320bee3d36939351f9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_07cb5a3282896320bee3d36939351f9c.jpg already downloaded
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fca%252F2fca6fa706a12fd9381debf771b8e8f1%252Fpa%252FNR82041_3db830f4139829cb537d821cbd7109d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_3db830f4139829cb537d821cbd7109d8.jpg already downloaded
2026-03-28 20:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55094067-9dae-5906-9e44-829836aca38b, identifier: NR82041
2026-03-28 20:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:27 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-28 20:35:27 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-28 20:35:27 [auto1.be] INFO: Scrape type for CT30439: 2
2026-03-28 20:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-28 20:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42425bea-9115-5bff-9500-4f498b2837f6 with scrape type 2
2026-03-28 20:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42425bea-9115-5bff-9500-4f498b2837f6 with scrape type 2
2026-03-28 20:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42425bea-9115-5bff-9500-4f498b2837f6, identifier: CT30439
2026-03-28 20:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041
2026-03-28 20:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041
2026-03-28 20:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55094067-9dae-5906-9e44-829836aca38b with identifier: NR82041 to the API
2026-03-28 20:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NR82041>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:08:29Z',
 'fuel_type': 'petrol',
 'id': '55094067-9dae-5906-9e44-829836aca38b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR82041',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 5288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_02ec5f0aa8f0da96c34d366313d22d7d.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_bda3f33716d93d5c15426898f223a5e0.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_c295c48a34db14cddc37522c5639b09f.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_ecd820da7519aa0d1c7d46ebbbce89a7.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_1c3210261c3547ec128ea2ef05306b44.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_9eddab043fdf29d636e3ff121ffcf3b1.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_72a55c275736d4127a65e98e48bcfefd.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_da4832a4aaa36ee9967bbb519732fb69.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_07cb5a3282896320bee3d36939351f9c.jpg',
                'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_3db830f4139829cb537d821cbd7109d8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_02ec5f0aa8f0da96c34d366313d22d7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_bda3f33716d93d5c15426898f223a5e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_c295c48a34db14cddc37522c5639b09f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_ecd820da7519aa0d1c7d46ebbbce89a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_1c3210261c3547ec128ea2ef05306b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_9eddab043fdf29d636e3ff121ffcf3b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_72a55c275736d4127a65e98e48bcfefd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_da4832a4aaa36ee9967bbb519732fb69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_07cb5a3282896320bee3d36939351f9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55094067-9dae-5906-9e44-829836aca38b/55094067-9dae-5906-9e44-829836aca38b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/ca/2fca6fa706a12fd9381debf771b8e8f1/pa/NR82041_3db830f4139829cb537d821cbd7109d8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 200 Final Edition AMG Line',
 'transmission': 'automatic',
 'trim': 'Final Edition AMG Line',
 'year': 2020}
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Saving data for NR82041: {'created_time': 1774730128.156891, 'last_price_update_time': 1774730128.156902, 'auction_closing_time': 1774883309.0}
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NR82041') HTTP/1.1" 204 0
2026-03-28 20:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-28 20:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-28 20:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439 to the API
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:31Z',
 'fuel_type': 'petrol',
 'id': '42425bea-9115-5bff-9500-4f498b2837f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT30439',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 118676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Saving data for CT30439: {'auction_closing_time': 1774884571.0, 'created_time': 1774524932.663709, 'last_price_update_time': 1774730128.45018}
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CT30439') HTTP/1.1" 204 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Scrape type for RK12486: 2
2026-03-28 20:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-28 20:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with scrape type 2
2026-03-28 20:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with scrape type 2
2026-03-28 20:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a3bb856-96e4-574e-91fa-fa2220a9ea70, identifier: RK12486
2026-03-28 20:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK19302> (referer: https://www.auto1.com/v1/car-details-view/AK19302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-28 20:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-28 20:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486 to the API
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:25Z',
 'fuel_type': 'diesel',
 'id': '5a3bb856-96e4-574e-91fa-fa2220a9ea70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK12486',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 231164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2013}
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Saving data for RK12486: {'auction_closing_time': 1774883485.0, 'created_time': 1774524942.120289, 'last_price_update_time': 1774730128.921178}
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK12486') HTTP/1.1" 204 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-28 20:35:28 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-28 20:35:28 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-28 20:35:29 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 20:35:29 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-28 20:35:29 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 20:35:29 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-28 20:35:29 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 20:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302
2026-03-28 20:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with scrape type 1
2026-03-28 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5b4f0fbb-756d-5ded-ac2f-11491a821a6d
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F63%252F0a63c57d1f7529d3417305111244e3a3%252Fpa%252FAK19302_2db5bd45a3e1a72577c1f277db0c6ed2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_2db5bd45a3e1a72577c1f277db0c6ed2.jpg already downloaded
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F63%252F0a63c57d1f7529d3417305111244e3a3%252Fpa%252FAK19302_1a004470f69257b57d01c5ca40b4fd95.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_1a004470f69257b57d01c5ca40b4fd95.jpg already downloaded
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F63%252F0a63c57d1f7529d3417305111244e3a3%252Fpa%252FAK19302_156c5c7c9a43638024ba71d636149310.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_156c5c7c9a43638024ba71d636149310.jpg already downloaded
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F63%252F0a63c57d1f7529d3417305111244e3a3%252Fpa%252FAK19302_26566499889d4f0c4f16596fcd26b8ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_26566499889d4f0c4f16596fcd26b8ab.jpg already downloaded
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F63%252F0a63c57d1f7529d3417305111244e3a3%252Fpa%252FAK19302_d2c44755fe670e4d276c799ac6d08681.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_d2c44755fe670e4d276c799ac6d08681.jpg already downloaded
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F63%252F0a63c57d1f7529d3417305111244e3a3%252Fpa%252FAK19302_2d5e118c22bb814419de42d54fe2a628.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_2d5e118c22bb814419de42d54fe2a628.jpg already downloaded
2026-03-28 20:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d, identifier: AK19302
2026-03-28 20:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302
2026-03-28 20:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302
2026-03-28 20:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b4f0fbb-756d-5ded-ac2f-11491a821a6d with identifier: AK19302 to the API
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AK19302>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:03:01Z',
 'fuel_type': 'diesel',
 'id': '5b4f0fbb-756d-5ded-ac2f-11491a821a6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK19302',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 428932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_2db5bd45a3e1a72577c1f277db0c6ed2.jpg',
                'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_1a004470f69257b57d01c5ca40b4fd95.jpg',
                'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_156c5c7c9a43638024ba71d636149310.jpg',
                'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_26566499889d4f0c4f16596fcd26b8ab.jpg',
                'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_d2c44755fe670e4d276c799ac6d08681.jpg',
                'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_2d5e118c22bb814419de42d54fe2a628.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b4f0fbb-756d-5ded-ac2f-11491a821a6d/5b4f0fbb-756d-5ded-ac2f-11491a821a6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_2db5bd45a3e1a72577c1f277db0c6ed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b4f0fbb-756d-5ded-ac2f-11491a821a6d/5b4f0fbb-756d-5ded-ac2f-11491a821a6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_1a004470f69257b57d01c5ca40b4fd95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b4f0fbb-756d-5ded-ac2f-11491a821a6d/5b4f0fbb-756d-5ded-ac2f-11491a821a6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_156c5c7c9a43638024ba71d636149310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b4f0fbb-756d-5ded-ac2f-11491a821a6d/5b4f0fbb-756d-5ded-ac2f-11491a821a6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_26566499889d4f0c4f16596fcd26b8ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b4f0fbb-756d-5ded-ac2f-11491a821a6d/5b4f0fbb-756d-5ded-ac2f-11491a821a6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_d2c44755fe670e4d276c799ac6d08681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b4f0fbb-756d-5ded-ac2f-11491a821a6d/5b4f0fbb-756d-5ded-ac2f-11491a821a6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/63/0a63c57d1f7529d3417305111244e3a3/pa/AK19302_2d5e118c22bb814419de42d54fe2a628.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Grand Edition 25th',
 'transmission': 'manual',
 'trim': 'Grand Edition 25th',
 'year': 2010}
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-28 20:35:29 [auto1.be] INFO: Saving data for AK19302: {'created_time': 1774730129.587781, 'last_price_update_time': 1774730129.587794, 'auction_closing_time': 1774882981.0}
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK19302') HTTP/1.1" 204 0
2026-03-28 20:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:30 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for ZL62218: 1
2026-03-28 20:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-28 20:35:30 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-28 20:35:30 [auto1.be] INFO: Scrape type for EV46077: 2
2026-03-28 20:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-28 20:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c460296-1576-59d0-8fcf-26a714b03f68 with scrape type 2
2026-03-28 20:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c460296-1576-59d0-8fcf-26a714b03f68 with scrape type 2
2026-03-28 20:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c460296-1576-59d0-8fcf-26a714b03f68, identifier: EV46077
2026-03-28 20:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 20:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-28 20:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077 to the API
2026-03-28 20:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:50:52Z',
 'fuel_type': 'petrol',
 'id': '4c460296-1576-59d0-8fcf-26a714b03f68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV46077',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 114443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2011}
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-28 20:35:31 [auto1.be] INFO: Saving data for EV46077: {'auction_closing_time': 1774885852.0, 'created_time': 1774524991.51853, 'last_price_update_time': 1774730131.581148}
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV46077') HTTP/1.1" 204 0
2026-03-28 20:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:31 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-28 20:35:31 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-28 20:35:31 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-28 20:35:31 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-28 20:35:31 [auto1.be] INFO: Scrape type for GR79063: 2
2026-03-28 20:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-28 20:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0faee88b-dade-52f1-934c-ab2f9f671d2b with scrape type 2
2026-03-28 20:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0faee88b-dade-52f1-934c-ab2f9f671d2b with scrape type 2
2026-03-28 20:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0faee88b-dade-52f1-934c-ab2f9f671d2b, identifier: GR79063
2026-03-28 20:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-28 20:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-28 20:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063 to the API
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:30:27Z',
 'fuel_type': 'diesel',
 'id': '0faee88b-dade-52f1-934c-ab2f9f671d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR79063',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 141474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-19',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Business Eco2',
 'transmission': 'manual',
 'trim': 'Business Eco2',
 'year': 2015}
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Saving data for GR79063: {'auction_closing_time': 1774884627.0, 'created_time': 1774524980.412381, 'last_price_update_time': 1774730132.105655}
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR79063') HTTP/1.1" 204 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 20:35:32 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-28 20:35:32 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-28 20:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL62218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:33 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for RY85405: 2
2026-03-28 20:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-28 20:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f308b866-e519-553c-bdb7-b407ae95e0a3 with scrape type 2
2026-03-28 20:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f308b866-e519-553c-bdb7-b407ae95e0a3 with scrape type 2
2026-03-28 20:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f308b866-e519-553c-bdb7-b407ae95e0a3, identifier: RY85405
2026-03-28 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-28 20:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-28 20:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405 to the API
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:01:07Z',
 'fuel_type': 'diesel',
 'id': 'f308b866-e519-553c-bdb7-b407ae95e0a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY85405',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Saving data for RY85405: {'auction_closing_time': 1774882867.0, 'created_time': 1774524985.470521, 'last_price_update_time': 1774730133.538733}
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY85405') HTTP/1.1" 204 0
2026-03-28 20:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-28 20:35:33 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-28 20:35:33 [auto1.be] INFO: Scrape type for BT94428: 2
2026-03-28 20:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-28 20:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with scrape type 2
2026-03-28 20:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with scrape type 2
2026-03-28 20:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60, identifier: BT94428
2026-03-28 20:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 20:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-28 20:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428 to the API
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-30T15:53:06Z',
 'fuel_type': 'hybrid',
 'id': 'a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT94428',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 164578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription Expression 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2020}
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-28 20:35:34 [auto1.be] INFO: Saving data for BT94428: {'auction_closing_time': 1774885986.0, 'created_time': 1774524935.464035, 'last_price_update_time': 1774730134.945503}
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT94428') HTTP/1.1" 204 0
2026-03-28 20:35:34 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-28 20:35:34 [auto1.be] INFO: Scrape type for WC55286: 2
2026-03-28 20:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-28 20:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e465e6fd-fb29-5377-a170-172043a7b3bc with scrape type 2
2026-03-28 20:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e465e6fd-fb29-5377-a170-172043a7b3bc with scrape type 2
2026-03-28 20:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e465e6fd-fb29-5377-a170-172043a7b3bc, identifier: WC55286
2026-03-28 20:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 20:35:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-28 20:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286 to the API
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:29:50Z',
 'fuel_type': 'diesel',
 'id': 'e465e6fd-fb29-5377-a170-172043a7b3bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC55286',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 215455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-22',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-28 20:35:35 [auto1.be] INFO: Saving data for WC55286: {'auction_closing_time': 1774884590.0, 'created_time': 1774524944.983296, 'last_price_update_time': 1774730135.541813}
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC55286') HTTP/1.1" 204 0
2026-03-28 20:35:35 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 20:35:35 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 20:35:35 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 20:35:35 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-28 20:35:35 [auto1.be] INFO: Scrape type for MG81689: 2
2026-03-28 20:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-28 20:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with scrape type 2
2026-03-28 20:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with scrape type 2
2026-03-28 20:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c, identifier: MG81689
2026-03-28 20:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-28 20:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-28 20:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689 to the API
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:16Z',
 'fuel_type': 'petrol',
 'id': 'cfe4be9f-131e-5380-a3ba-1ca82ec2e80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG81689',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 114137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-01',
 'seller_name': None,
 'title': 'Renault Clio 1.6 Night and Day',
 'transmission': 'automatic',
 'trim': 'Night and Day',
 'year': 2012}
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-28 20:35:36 [auto1.be] INFO: Saving data for MG81689: {'auction_closing_time': 1774884076.0, 'created_time': 1774524968.056158, 'last_price_update_time': 1774730136.053984}
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG81689') HTTP/1.1" 204 0
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-28 20:35:36 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-28 20:35:36 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 20:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:36 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-28 20:35:36 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 20:35:36 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for NN42853: 2
2026-03-28 20:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-28 20:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with scrape type 2
2026-03-28 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with scrape type 2
2026-03-28 20:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3a8f7bf-03be-59d5-8042-8d30f99dccb1, identifier: NN42853
2026-03-28 20:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-28 20:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-28 20:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853 to the API
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:01:05Z',
 'fuel_type': 'petrol',
 'id': 'd3a8f7bf-03be-59d5-8042-8d30f99dccb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN42853',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 44541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Creative',
 'transmission': 'automatic',
 'trim': 'Creative',
 'year': 2022}
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Saving data for NN42853: {'auction_closing_time': 1774882865.0, 'created_time': 1774524941.213103, 'last_price_update_time': 1774730137.4454}
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN42853') HTTP/1.1" 204 0
2026-03-28 20:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-28 20:35:37 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-28 20:35:37 [auto1.be] INFO: Scrape type for YM63500: 2
2026-03-28 20:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-28 20:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with scrape type 2
2026-03-28 20:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with scrape type 2
2026-03-28 20:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea, identifier: YM63500
2026-03-28 20:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-28 20:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500
2026-03-28 20:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29f8fd09-4026-5a84-97ce-6a3bc50c58ea with identifier: YM63500 to the API
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:07Z',
 'fuel_type': 'diesel',
 'id': '29f8fd09-4026-5a84-97ce-6a3bc50c58ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM63500',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 119815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 2WD',
 'transmission': 'manual',
 'trim': '2WD',
 'year': 2019}
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Saving data for YM63500: {'auction_closing_time': 1774884607.0, 'created_time': 1773384022.03285, 'last_price_update_time': 1774730138.219427}
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YM63500') HTTP/1.1" 204 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Scrape type for YW29468: 2
2026-03-28 20:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-28 20:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91452478-9f75-5f80-adf9-e9c228fd122a with scrape type 2
2026-03-28 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91452478-9f75-5f80-adf9-e9c228fd122a with scrape type 2
2026-03-28 20:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 91452478-9f75-5f80-adf9-e9c228fd122a, identifier: YW29468
2026-03-28 20:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL62218> (referer: https://www.auto1.com/v1/car-details-view/ZL62218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-28 20:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-28 20:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468 to the API
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:04Z',
 'fuel_type': 'diesel',
 'id': '91452478-9f75-5f80-adf9-e9c228fd122a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW29468',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 187363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2018}
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Saving data for YW29468: {'auction_closing_time': 1774884424.0, 'created_time': 1774524953.567365, 'last_price_update_time': 1774730138.796642}
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW29468') HTTP/1.1" 204 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-28 20:35:38 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 20:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218
2026-03-28 20:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0afc726-a3d4-560b-8a8b-2eaf6928a67a with scrape type 1
2026-03-28 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0afc726-a3d4-560b-8a8b-2eaf6928a67a
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_369cbe42fa0aae3016f2d4da4728f107.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_369cbe42fa0aae3016f2d4da4728f107.jpg already downloaded
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_27cec63edfc39dc77ce83bdb4071319f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_27cec63edfc39dc77ce83bdb4071319f.jpg already downloaded
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_63784dbd60efcca38dd5445c3be1485e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_63784dbd60efcca38dd5445c3be1485e.jpg already downloaded
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_c69be49d6902c711fd4fe75a96eb01cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_c69be49d6902c711fd4fe75a96eb01cd.jpg already downloaded
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_7513572b244f63937af8258f12ec02a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_7513572b244f63937af8258f12ec02a1.jpg already downloaded
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_264ce54101eaf65aebc267c686929dd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_264ce54101eaf65aebc267c686929dd9.jpg already downloaded
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_aaddb74e7f55e9120a8dcf27091206f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_aaddb74e7f55e9120a8dcf27091206f8.jpg already downloaded
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_26e04bb35852b70d1f9a73de490b8ee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_26e04bb35852b70d1f9a73de490b8ee2.jpg already downloaded
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_49d3ec29292906d52c31b7a79bc6eede.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_49d3ec29292906d52c31b7a79bc6eede.jpg already downloaded
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F14%252F0a140c864e56d78e4cea59e0c8050978%252Fpa%252FZL62218_f0cf3b9b9fa401e6a82092eb90540b88.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_f0cf3b9b9fa401e6a82092eb90540b88.jpg already downloaded
2026-03-28 20:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0afc726-a3d4-560b-8a8b-2eaf6928a67a, identifier: ZL62218
2026-03-28 20:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218
2026-03-28 20:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218
2026-03-28 20:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0afc726-a3d4-560b-8a8b-2eaf6928a67a with identifier: ZL62218 to the API
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL62218>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:28Z',
 'fuel_type': 'diesel',
 'id': 'b0afc726-a3d4-560b-8a8b-2eaf6928a67a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL62218',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mazda',
 'model': '3',
 'odometer': 95643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_369cbe42fa0aae3016f2d4da4728f107.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_27cec63edfc39dc77ce83bdb4071319f.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_63784dbd60efcca38dd5445c3be1485e.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_c69be49d6902c711fd4fe75a96eb01cd.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_7513572b244f63937af8258f12ec02a1.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_264ce54101eaf65aebc267c686929dd9.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_aaddb74e7f55e9120a8dcf27091206f8.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_26e04bb35852b70d1f9a73de490b8ee2.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_49d3ec29292906d52c31b7a79bc6eede.jpg',
                'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_f0cf3b9b9fa401e6a82092eb90540b88.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_369cbe42fa0aae3016f2d4da4728f107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_27cec63edfc39dc77ce83bdb4071319f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_63784dbd60efcca38dd5445c3be1485e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_c69be49d6902c711fd4fe75a96eb01cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_7513572b244f63937af8258f12ec02a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_264ce54101eaf65aebc267c686929dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_aaddb74e7f55e9120a8dcf27091206f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_26e04bb35852b70d1f9a73de490b8ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_49d3ec29292906d52c31b7a79bc6eede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0afc726-a3d4-560b-8a8b-2eaf6928a67a/b0afc726-a3d4-560b-8a8b-2eaf6928a67a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/14/0a140c864e56d78e4cea59e0c8050978/pa/ZL62218_f0cf3b9b9fa401e6a82092eb90540b88.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.5 Diesel Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2017}
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-28 20:35:39 [auto1.be] INFO: Saving data for ZL62218: {'created_time': 1774730139.490723, 'last_price_update_time': 1774730139.490735, 'auction_closing_time': 1774882828.0}
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL62218') HTTP/1.1" 204 0
2026-03-28 20:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:40 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:40 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 20:35:40 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 20:35:40 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 20:35:40 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 20:35:40 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-28 20:35:40 [auto1.be] INFO: Scrape type for WA82695: 2
2026-03-28 20:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-28 20:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40829756-87ea-549d-9f2d-20fe2305b3cd with scrape type 2
2026-03-28 20:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40829756-87ea-549d-9f2d-20fe2305b3cd with scrape type 2
2026-03-28 20:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40829756-87ea-549d-9f2d-20fe2305b3cd, identifier: WA82695
2026-03-28 20:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-28 20:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695
2026-03-28 20:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40829756-87ea-549d-9f2d-20fe2305b3cd with identifier: WA82695 to the API
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:21:14Z',
 'fuel_type': 'petrol',
 'id': '40829756-87ea-549d-9f2d-20fe2305b3cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA82695',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 172767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 THP Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2016}
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-28 20:35:40 [auto1.be] INFO: Saving data for WA82695: {'auction_closing_time': 1774884074.0, 'created_time': 1774643727.751686, 'last_price_update_time': 1774730140.962027}
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA82695') HTTP/1.1" 204 0
2026-03-28 20:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:40 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-28 20:35:40 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for PP48497: 2
2026-03-28 20:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-28 20:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with scrape type 2
2026-03-28 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with scrape type 2
2026-03-28 20:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41, identifier: PP48497
2026-03-28 20:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-28 20:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-28 20:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497 to the API
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:44:54Z',
 'fuel_type': 'petrol',
 'id': '8cc6588e-a48a-5e8a-88e2-2b1f91922c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP48497',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 109933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2016}
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Saving data for PP48497: {'auction_closing_time': 1774885494.0, 'created_time': 1774524963.747881, 'last_price_update_time': 1774730141.555084}
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PP48497') HTTP/1.1" 204 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-28 20:35:41 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-28 20:35:41 [auto1.be] INFO: Scrape type for LT97220: 2
2026-03-28 20:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-28 20:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with scrape type 2
2026-03-28 20:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with scrape type 2
2026-03-28 20:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f, identifier: LT97220
2026-03-28 20:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-28 20:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-28 20:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220 to the API
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:51:20Z',
 'fuel_type': 'petrol',
 'id': '1b2bece5-3783-5852-bbc2-c53cfc6aea3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT97220',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 82658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-17',
 'seller_name': None,
 'title': 'Ford Fusion 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Saving data for LT97220: {'auction_closing_time': 1774885880.0, 'created_time': 1774524984.426966, 'last_price_update_time': 1774730142.231194}
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT97220') HTTP/1.1" 204 0
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Scrape type for ML35155: 2
2026-03-28 20:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-28 20:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27431265-39ba-5c53-a9c2-ee1d17379273 with scrape type 2
2026-03-28 20:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27431265-39ba-5c53-a9c2-ee1d17379273 with scrape type 2
2026-03-28 20:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27431265-39ba-5c53-a9c2-ee1d17379273, identifier: ML35155
2026-03-28 20:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-28 20:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-28 20:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155 to the API
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:26:31Z',
 'fuel_type': 'diesel',
 'id': '27431265-39ba-5c53-a9c2-ee1d17379273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML35155',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 259006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Saving data for ML35155: {'auction_closing_time': 1774884391.0, 'created_time': 1774524991.884173, 'last_price_update_time': 1774730142.809833}
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML35155') HTTP/1.1" 204 0
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-28 20:35:42 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 20:35:42 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 20:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:43 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:43 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 20:35:43 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-28 20:35:43 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-28 20:35:43 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-28 20:35:43 [auto1.be] INFO: Scrape type for TK93480: 2
2026-03-28 20:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-28 20:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with scrape type 2
2026-03-28 20:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with scrape type 2
2026-03-28 20:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba, identifier: TK93480
2026-03-28 20:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-28 20:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-28 20:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480 to the API
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:41:32Z',
 'fuel_type': 'diesel',
 'id': '7d6d8759-6b2c-54ac-a9a5-f2967f224dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK93480',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 163254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-08',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 dCi Diesel Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Saving data for TK93480: {'auction_closing_time': 1774885292.0, 'created_time': 1774524925.555339, 'last_price_update_time': 1774730144.241136}
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK93480') HTTP/1.1" 204 0
2026-03-28 20:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-28 20:35:44 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-28 20:35:44 [auto1.be] INFO: Scrape type for SX32022: 2
2026-03-28 20:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-28 20:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e962ff3b-5daf-58c4-878a-679afeaf0974 with scrape type 2
2026-03-28 20:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e962ff3b-5daf-58c4-878a-679afeaf0974 with scrape type 2
2026-03-28 20:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e962ff3b-5daf-58c4-878a-679afeaf0974, identifier: SX32022
2026-03-28 20:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-28 20:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022
2026-03-28 20:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e962ff3b-5daf-58c4-878a-679afeaf0974 with identifier: SX32022 to the API
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:24:15Z',
 'fuel_type': 'petrol',
 'id': 'e962ff3b-5daf-58c4-878a-679afeaf0974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX32022',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 97443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-18',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Saving data for SX32022: {'auction_closing_time': 1774884255.0, 'created_time': 1773909325.798418, 'last_price_update_time': 1774730145.019848}
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX32022') HTTP/1.1" 204 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for ZJ76170: 2
2026-03-28 20:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-28 20:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with scrape type 2
2026-03-28 20:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with scrape type 2
2026-03-28 20:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e, identifier: ZJ76170
2026-03-28 20:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-28 20:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-28 20:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170 to the API
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:20Z',
 'fuel_type': 'petrol',
 'id': '98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ76170',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 122576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Saving data for ZJ76170: {'auction_closing_time': 1774883540.0, 'created_time': 1774524964.609558, 'last_price_update_time': 1774730145.572338}
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ76170') HTTP/1.1" 204 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-28 20:35:45 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-28 20:35:45 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 20:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:46 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-28 20:35:46 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-28 20:35:46 [auto1.be] INFO: Scrape type for YN26679: 2
2026-03-28 20:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-28 20:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with scrape type 2
2026-03-28 20:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with scrape type 2
2026-03-28 20:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a, identifier: YN26679
2026-03-28 20:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-28 20:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-28 20:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679 to the API
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:35:50Z',
 'fuel_type': 'petrol',
 'id': '1fc9325a-8b8b-5139-b0a7-0ccf1445e31a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN26679',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 133185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-06',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2005}
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-28 20:35:47 [auto1.be] INFO: Saving data for YN26679: {'auction_closing_time': 1774884950.0, 'created_time': 1774524948.559891, 'last_price_update_time': 1774730147.263211}
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN26679') HTTP/1.1" 204 0
2026-03-28 20:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-28 20:35:47 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-28 20:35:47 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-28 20:35:47 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-28 20:35:47 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-28 20:35:47 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-28 20:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:48 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 20:35:48 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-28 20:35:48 [auto1.be] INFO: Scrape type for HK81119: 2
2026-03-28 20:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-28 20:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64bbbfff-6905-504b-a81b-7851df51f18e with scrape type 2
2026-03-28 20:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64bbbfff-6905-504b-a81b-7851df51f18e with scrape type 2
2026-03-28 20:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64bbbfff-6905-504b-a81b-7851df51f18e, identifier: HK81119
2026-03-28 20:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-28 20:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-28 20:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119 to the API
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'diesel',
 'id': '64bbbfff-6905-504b-a81b-7851df51f18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK81119',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 136811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-24',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Edition Standard',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Edition Standard',
 'year': 2017}
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Saving data for HK81119: {'auction_closing_time': 1774884997.0, 'created_time': 1774524949.236712, 'last_price_update_time': 1774730149.090724}
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK81119') HTTP/1.1" 204 0
2026-03-28 20:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for VK66376: 2
2026-03-28 20:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-28 20:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059b1df0-5814-574a-965a-c5fe9f46e39a with scrape type 2
2026-03-28 20:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 059b1df0-5814-574a-965a-c5fe9f46e39a with scrape type 2
2026-03-28 20:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 059b1df0-5814-574a-965a-c5fe9f46e39a, identifier: VK66376
2026-03-28 20:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-28 20:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-28 20:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376 to the API
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:32:08Z',
 'fuel_type': 'diesel',
 'id': '059b1df0-5814-574a-965a-c5fe9f46e39a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK66376',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 303310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Saving data for VK66376: {'auction_closing_time': 1774884728.0, 'created_time': 1774524922.993098, 'last_price_update_time': 1774730149.667437}
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VK66376') HTTP/1.1" 204 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-28 20:35:49 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-28 20:35:49 [auto1.be] INFO: Scrape type for DP88518: 2
2026-03-28 20:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-28 20:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with scrape type 2
2026-03-28 20:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with scrape type 2
2026-03-28 20:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a4727c9-74d7-5a9c-bbd6-b359597c1961, identifier: DP88518
2026-03-28 20:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-28 20:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-28 20:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518 to the API
2026-03-28 20:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:58Z',
 'fuel_type': 'diesel',
 'id': '4a4727c9-74d7-5a9c-bbd6-b359597c1961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP88518',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 78421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2022}
2026-03-28 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-28 20:35:50 [auto1.be] INFO: Saving data for DP88518: {'auction_closing_time': 1774885738.0, 'created_time': 1774524971.043457, 'last_price_update_time': 1774730150.275253}
2026-03-28 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP88518') HTTP/1.1" 204 0
2026-03-28 20:35:50 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-28 20:35:50 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 20:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:51 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-28 20:35:51 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 20:35:51 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 20:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:52 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-28 20:35:52 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-28 20:35:52 [auto1.be] INFO: Scrape type for AG87445: 2
2026-03-28 20:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-28 20:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5b75cb-574d-5037-83d7-0dd641cabc89 with scrape type 2
2026-03-28 20:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d5b75cb-574d-5037-83d7-0dd641cabc89 with scrape type 2
2026-03-28 20:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d5b75cb-574d-5037-83d7-0dd641cabc89, identifier: AG87445
2026-03-28 20:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-28 20:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445
2026-03-28 20:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d5b75cb-574d-5037-83d7-0dd641cabc89 with identifier: AG87445 to the API
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:40:03Z',
 'fuel_type': 'diesel',
 'id': '9d5b75cb-574d-5037-83d7-0dd641cabc89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG87445',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 296960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L2 Limited',
 'transmission': 'automatic',
 'trim': '320 L2 Limited',
 'year': 2021}
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-28 20:35:53 [auto1.be] INFO: Saving data for AG87445: {'auction_closing_time': 1774885203.0, 'created_time': 1774643744.61289, 'last_price_update_time': 1774730153.249347}
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG87445') HTTP/1.1" 204 0
2026-03-28 20:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-28 20:35:53 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-28 20:35:53 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-28 20:35:53 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-28 20:35:53 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 20:35:53 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-28 20:35:53 [auto1.be] INFO: Scrape type for YA14339: 2
2026-03-28 20:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-28 20:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eff9184-820c-50ba-a803-b4fc692dfb52 with scrape type 2
2026-03-28 20:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eff9184-820c-50ba-a803-b4fc692dfb52 with scrape type 2
2026-03-28 20:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4eff9184-820c-50ba-a803-b4fc692dfb52, identifier: YA14339
2026-03-28 20:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 20:35:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-28 20:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339 to the API
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:34Z',
 'fuel_type': 'diesel',
 'id': '4eff9184-820c-50ba-a803-b4fc692dfb52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA14339',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 225421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-08',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2015}
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Saving data for YA14339: {'auction_closing_time': 1774883434.0, 'created_time': 1774524953.133571, 'last_price_update_time': 1774730154.045311}
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA14339') HTTP/1.1" 204 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Scrape type for JZ92177: 2
2026-03-28 20:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-28 20:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with scrape type 2
2026-03-28 20:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with scrape type 2
2026-03-28 20:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 979ebab0-c3db-57cc-9de9-b9e30813e9d1, identifier: JZ92177
2026-03-28 20:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-28 20:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177
2026-03-28 20:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 979ebab0-c3db-57cc-9de9-b9e30813e9d1 with identifier: JZ92177 to the API
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:20:50Z',
 'fuel_type': 'petrol',
 'id': '979ebab0-c3db-57cc-9de9-b9e30813e9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ92177',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 19719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-07',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2024}
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Saving data for JZ92177: {'auction_closing_time': 1774884050.0, 'created_time': 1773238513.89548, 'last_price_update_time': 1774730154.484794}
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ92177') HTTP/1.1" 204 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-28 20:35:54 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-28 20:35:54 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 20:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:55 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:55 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 20:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-28 20:35:55 [auto1.be] INFO: Scrape type for VL69873: 2
2026-03-28 20:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-28 20:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with scrape type 2
2026-03-28 20:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with scrape type 2
2026-03-28 20:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5, identifier: VL69873
2026-03-28 20:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-28 20:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873
2026-03-28 20:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5 with identifier: VL69873 to the API
2026-03-28 20:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:28:03Z',
 'fuel_type': 'diesel',
 'id': '5d0b95e9-e75c-554c-a9a3-d51dfa21b1b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL69873',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 196575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Saving data for VL69873: {'auction_closing_time': 1774884483.0, 'created_time': 1773866411.866313, 'last_price_update_time': 1774730156.176682}
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL69873') HTTP/1.1" 204 0
2026-03-28 20:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for FK29667: 2
2026-03-28 20:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-28 20:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6fa5728-227f-5472-97d4-e131b884a993 with scrape type 2
2026-03-28 20:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6fa5728-227f-5472-97d4-e131b884a993 with scrape type 2
2026-03-28 20:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6fa5728-227f-5472-97d4-e131b884a993, identifier: FK29667
2026-03-28 20:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-28 20:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-28 20:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667 to the API
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:11:50Z',
 'fuel_type': 'diesel',
 'id': 'b6fa5728-227f-5472-97d4-e131b884a993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK29667',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 164568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Pritsche 50 lang RWD',
 'transmission': 'manual',
 'trim': 'Pritsche 50 lang RWD',
 'year': 2020}
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Saving data for FK29667: {'auction_closing_time': 1774883510.0, 'created_time': 1774524980.883255, 'last_price_update_time': 1774730156.715593}
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK29667') HTTP/1.1" 204 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-28 20:35:56 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 20:35:56 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for UC56570: 1
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-28 20:35:57 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-28 20:35:57 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 20:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:58 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1094 | hits on page: 40
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for YT15018: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for HF54985: 2
2026-03-28 20:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985
2026-03-28 20:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c636eb8-c38e-5634-ac96-cec88a7229f6 with scrape type 2
2026-03-28 20:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c636eb8-c38e-5634-ac96-cec88a7229f6 with scrape type 2
2026-03-28 20:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0c636eb8-c38e-5634-ac96-cec88a7229f6, identifier: HF54985
2026-03-28 20:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985
2026-03-28 20:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985
2026-03-28 20:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0c636eb8-c38e-5634-ac96-cec88a7229f6 with identifier: HF54985 to the API
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:34Z',
 'fuel_type': 'diesel',
 'id': '0c636eb8-c38e-5634-ac96-cec88a7229f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF54985',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 149553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2020}
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Saving data for HF54985: {'auction_closing_time': 1774884094.0, 'created_time': 1773384242.175189, 'last_price_update_time': 1774730158.682608}
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HF54985') HTTP/1.1" 204 0
2026-03-28 20:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-28 20:35:58 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-28 20:35:58 [auto1.be] INFO: Scrape type for JP67733: 2
2026-03-28 20:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-28 20:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba092004-345f-5dc4-93eb-fb7dd27a70dd with scrape type 2
2026-03-28 20:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba092004-345f-5dc4-93eb-fb7dd27a70dd with scrape type 2
2026-03-28 20:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba092004-345f-5dc4-93eb-fb7dd27a70dd, identifier: JP67733
2026-03-28 20:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-28 20:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733
2026-03-28 20:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba092004-345f-5dc4-93eb-fb7dd27a70dd with identifier: JP67733 to the API
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:09:58Z',
 'fuel_type': 'hybrid',
 'id': 'ba092004-345f-5dc4-93eb-fb7dd27a70dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP67733',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 185798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 Hybrid BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'BlueTEC Elegance',
 'year': 2015}
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Saving data for JP67733: {'auction_closing_time': 1774883398.0, 'created_time': 1774643744.04436, 'last_price_update_time': 1774730159.271662}
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JP67733') HTTP/1.1" 204 0
2026-03-28 20:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC56570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-28 20:35:59 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 20:35:59 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 20:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC56570> (referer: https://www.auto1.com/v1/car-details-view/UC56570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570
2026-03-28 20:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with scrape type 1
2026-03-28 20:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b0f07f45-e8a7-54b0-aff5-40a2a981abb5
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd2%252Fd3d2552296f99a4c6681d0fc3338b86a%252Fpa%252FUC56570_d6a5f88c64cd00ee6d6487626097e59a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_d6a5f88c64cd00ee6d6487626097e59a.jpg already downloaded
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd2%252Fd3d2552296f99a4c6681d0fc3338b86a%252Fpa%252FUC56570_bb3988a96aeacd584abab395f2e14d01.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_bb3988a96aeacd584abab395f2e14d01.jpg already downloaded
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd2%252Fd3d2552296f99a4c6681d0fc3338b86a%252Fpa%252FUC56570_6d74158042d8a3f8963c2076e6335ca5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_6d74158042d8a3f8963c2076e6335ca5.jpg already downloaded
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd2%252Fd3d2552296f99a4c6681d0fc3338b86a%252Fpa%252FUC56570_aa249d571c4b1d113839125c47447827.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_aa249d571c4b1d113839125c47447827.jpg already downloaded
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fd2%252Fd3d2552296f99a4c6681d0fc3338b86a%252Fpa%252FUC56570_03e2ba231361516ddd8eed4731fc69c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_03e2ba231361516ddd8eed4731fc69c0.jpg already downloaded
2026-03-28 20:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0f07f45-e8a7-54b0-aff5-40a2a981abb5, identifier: UC56570
2026-03-28 20:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570
2026-03-28 20:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570
2026-03-28 20:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0f07f45-e8a7-54b0-aff5-40a2a981abb5 with identifier: UC56570 to the API
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UC56570>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'diesel',
 'id': 'b0f07f45-e8a7-54b0-aff5-40a2a981abb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC56570',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 336828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_d6a5f88c64cd00ee6d6487626097e59a.jpg',
                'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_bb3988a96aeacd584abab395f2e14d01.jpg',
                'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_6d74158042d8a3f8963c2076e6335ca5.jpg',
                'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_aa249d571c4b1d113839125c47447827.jpg',
                'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_03e2ba231361516ddd8eed4731fc69c0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0f07f45-e8a7-54b0-aff5-40a2a981abb5/b0f07f45-e8a7-54b0-aff5-40a2a981abb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_d6a5f88c64cd00ee6d6487626097e59a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0f07f45-e8a7-54b0-aff5-40a2a981abb5/b0f07f45-e8a7-54b0-aff5-40a2a981abb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_bb3988a96aeacd584abab395f2e14d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0f07f45-e8a7-54b0-aff5-40a2a981abb5/b0f07f45-e8a7-54b0-aff5-40a2a981abb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_6d74158042d8a3f8963c2076e6335ca5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0f07f45-e8a7-54b0-aff5-40a2a981abb5/b0f07f45-e8a7-54b0-aff5-40a2a981abb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_aa249d571c4b1d113839125c47447827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0f07f45-e8a7-54b0-aff5-40a2a981abb5/b0f07f45-e8a7-54b0-aff5-40a2a981abb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/d2/d3d2552296f99a4c6681d0fc3338b86a/pa/UC56570_03e2ba231361516ddd8eed4731fc69c0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.9 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Saving data for UC56570: {'created_time': 1774730161.083736, 'last_price_update_time': 1774730161.083748, 'auction_closing_time': 1774885534.0}
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC56570') HTTP/1.1" 204 0
2026-03-28 20:36:01 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1094 | hits on page: 40
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-28 20:36:01 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 20:36:01 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 20:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:02 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1094 | hits on page: 40
2026-03-28 20:36:02 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-28 20:36:02 [auto1.be] INFO: Scrape type for KU26204: 2
2026-03-28 20:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-28 20:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc75f6b6-f632-59f3-b824-437bc69208ee with scrape type 2
2026-03-28 20:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc75f6b6-f632-59f3-b824-437bc69208ee with scrape type 2
2026-03-28 20:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc75f6b6-f632-59f3-b824-437bc69208ee, identifier: KU26204
2026-03-28 20:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-28 20:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-28 20:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204 to the API
2026-03-28 20:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:32Z',
 'fuel_type': 'petrol',
 'id': 'fc75f6b6-f632-59f3-b824-437bc69208ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU26204',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 55645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-11',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Life Pack M',
 'transmission': 'manual',
 'trim': 'Life Pack M',
 'year': 2021}
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-28 20:36:03 [auto1.be] INFO: Saving data for KU26204: {'auction_closing_time': 1774884992.0, 'created_time': 1774524952.752341, 'last_price_update_time': 1774730163.041473}
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU26204') HTTP/1.1" 204 0
2026-03-28 20:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:03 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-28 20:36:03 [auto1.be] INFO: Scrape type for XE64009: 2
2026-03-28 20:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-28 20:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc4ff40-73f2-529a-842e-244a2a10a84f with scrape type 2
2026-03-28 20:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acc4ff40-73f2-529a-842e-244a2a10a84f with scrape type 2
2026-03-28 20:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acc4ff40-73f2-529a-842e-244a2a10a84f, identifier: XE64009
2026-03-28 20:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-28 20:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-28 20:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009 to the API
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'diesel',
 'id': 'acc4ff40-73f2-529a-842e-244a2a10a84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE64009',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 230277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-28 20:36:03 [auto1.be] INFO: Saving data for XE64009: {'auction_closing_time': 1774885441.0, 'created_time': 1774524970.16392, 'last_price_update_time': 1774730163.568894}
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE64009') HTTP/1.1" 204 0
2026-03-28 20:36:03 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-28 20:36:03 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-28 20:36:03 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 20:36:03 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-28 20:36:03 [auto1.be] INFO: Scrape type for ZG50395: 2
2026-03-28 20:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-28 20:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with scrape type 2
2026-03-28 20:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with scrape type 2
2026-03-28 20:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346, identifier: ZG50395
2026-03-28 20:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-28 20:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-28 20:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395 to the API
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:17Z',
 'fuel_type': 'diesel',
 'id': '2771e6e6-d7a8-5505-9977-4d8b3d8a4346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG50395',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 271982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-25',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-28 20:36:03 [auto1.be] INFO: Saving data for ZG50395: {'auction_closing_time': 1774885817.0, 'created_time': 1774524931.874126, 'last_price_update_time': 1774730163.99162}
2026-03-28 20:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG50395') HTTP/1.1" 204 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for FC74189: 2
2026-03-28 20:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-28 20:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64420a0a-efcf-5a5e-9856-20d70760fb2c with scrape type 2
2026-03-28 20:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64420a0a-efcf-5a5e-9856-20d70760fb2c with scrape type 2
2026-03-28 20:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64420a0a-efcf-5a5e-9856-20d70760fb2c, identifier: FC74189
2026-03-28 20:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-28 20:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-28 20:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189 to the API
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:17:39Z',
 'fuel_type': 'petrol',
 'id': '64420a0a-efcf-5a5e-9856-20d70760fb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC74189',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 27592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-09',
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Saving data for FC74189: {'auction_closing_time': 1774883859.0, 'created_time': 1774524937.946134, 'last_price_update_time': 1774730164.508628}
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC74189') HTTP/1.1" 204 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 20:36:04 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-28 20:36:04 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-28 20:36:06 [scrapy.extensions.logstats] INFO: Crawled 41 pages (at 41 pages/min), scraped 47 items (at 47 items/min)
2026-03-28 20:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-28 20:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:08 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1094 | hits on page: 40
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-28 20:36:08 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 20:36:08 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-28 20:36:08 [auto1.be] INFO: Scrape type for ZA01438: 2
2026-03-28 20:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-28 20:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with scrape type 2
2026-03-28 20:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with scrape type 2
2026-03-28 20:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fddc3a48-b91e-5192-9f45-8fee8ffc63d2, identifier: ZA01438
2026-03-28 20:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-28 20:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-28 20:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438 to the API
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'diesel',
 'id': 'fddc3a48-b91e-5192-9f45-8fee8ffc63d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA01438',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 198457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-11',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Saving data for ZA01438: {'auction_closing_time': 1774885289.0, 'created_time': 1774524981.495638, 'last_price_update_time': 1774730169.293318}
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZA01438') HTTP/1.1" 204 0
2026-03-28 20:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Scrape type for PY58607: 2
2026-03-28 20:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-28 20:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26bf0e1-cb66-5112-9cb6-b13a24f193db with scrape type 2
2026-03-28 20:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d26bf0e1-cb66-5112-9cb6-b13a24f193db with scrape type 2
2026-03-28 20:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d26bf0e1-cb66-5112-9cb6-b13a24f193db, identifier: PY58607
2026-03-28 20:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-28 20:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607
2026-03-28 20:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d26bf0e1-cb66-5112-9cb6-b13a24f193db with identifier: PY58607 to the API
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:28Z',
 'fuel_type': 'diesel',
 'id': 'd26bf0e1-cb66-5112-9cb6-b13a24f193db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY58607',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 155326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Standard',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Standard',
 'year': 2015}
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Saving data for PY58607: {'auction_closing_time': 1774886008.0, 'created_time': 1774643738.700245, 'last_price_update_time': 1774730169.803338}
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY58607') HTTP/1.1" 204 0
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 20:36:09 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-28 20:36:09 [auto1.be] INFO: Scrape type for XA29570: 2
2026-03-28 20:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-28 20:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72aa8770-46dd-5579-ac2c-097dda213bac with scrape type 2
2026-03-28 20:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72aa8770-46dd-5579-ac2c-097dda213bac with scrape type 2
2026-03-28 20:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 72aa8770-46dd-5579-ac2c-097dda213bac, identifier: XA29570
2026-03-28 20:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-28 20:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570
2026-03-28 20:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 72aa8770-46dd-5579-ac2c-097dda213bac with identifier: XA29570 to the API
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:35:39Z',
 'fuel_type': 'petrol',
 'id': '72aa8770-46dd-5579-ac2c-097dda213bac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA29570',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 101998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-07',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-28 20:36:10 [auto1.be] INFO: Saving data for XA29570: {'auction_closing_time': 1774884939.0, 'created_time': 1774643742.128975, 'last_price_update_time': 1774730170.267861}
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XA29570') HTTP/1.1" 204 0
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-28 20:36:10 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-28 20:36:10 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-28 20:36:10 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-28 20:36:10 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-28 20:36:10 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-28 20:36:10 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 20:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:11 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1094 | hits on page: 40
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Scrape type for BN53670: 0
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Scrape type for BP38818: 2
2026-03-28 20:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-28 20:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with scrape type 2
2026-03-28 20:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with scrape type 2
2026-03-28 20:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75, identifier: BP38818
2026-03-28 20:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-28 20:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-28 20:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818 to the API
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:24Z',
 'fuel_type': 'petrol',
 'id': '4b9a3fff-8724-56ad-aedb-5f4bbe542c75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP38818',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 147831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Saving data for BP38818: {'auction_closing_time': 1774886364.0, 'created_time': 1774524988.58517, 'last_price_update_time': 1774730171.783849}
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP38818') HTTP/1.1" 204 0
2026-03-28 20:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 20:36:11 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-28 20:36:11 [auto1.be] INFO: Scrape type for AU41446: 2
2026-03-28 20:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-28 20:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with scrape type 2
2026-03-28 20:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with scrape type 2
2026-03-28 20:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6, identifier: AU41446
2026-03-28 20:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-28 20:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446
2026-03-28 20:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78ea3ef9-b77e-5939-adfa-5f613fe9d2b6 with identifier: AU41446 to the API
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:55:24Z',
 'fuel_type': 'petrol',
 'id': '78ea3ef9-b77e-5939-adfa-5f613fe9d2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU41446',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 100071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-02-12',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse 300 SE',
 'transmission': 'automatic',
 'trim': '',
 'year': 1992}
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Saving data for AU41446: {'auction_closing_time': 1774886124.0, 'created_time': 1774643739.900579, 'last_price_update_time': 1774730172.327366}
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU41446') HTTP/1.1" 204 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for NJ59863: 2
2026-03-28 20:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-28 20:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with scrape type 2
2026-03-28 20:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with scrape type 2
2026-03-28 20:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e, identifier: NJ59863
2026-03-28 20:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-28 20:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-28 20:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863 to the API
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:59:29Z',
 'fuel_type': 'petrol',
 'id': 'f3c38ce8-5ab1-56d2-80d8-4181e33ac78e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ59863',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 66923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seller_name': None,
 'title': 'BMW 4er 420i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Saving data for NJ59863: {'auction_closing_time': 1774886369.0, 'created_time': 1774524927.251376, 'last_price_update_time': 1774730172.738024}
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ59863') HTTP/1.1" 204 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 20:36:12 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-28 20:36:12 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-28 20:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:44 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1094 | hits on page: 40
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for JW78855: 2
2026-03-28 20:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-28 20:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with scrape type 2
2026-03-28 20:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with scrape type 2
2026-03-28 20:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8, identifier: JW78855
2026-03-28 20:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-28 20:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-28 20:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855 to the API
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:31:23Z',
 'fuel_type': 'petrol',
 'id': '5aab7a44-8f6d-5835-a2c6-84417fec9eb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW78855',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 155220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Saving data for JW78855: {'auction_closing_time': 1774884683.0, 'created_time': 1774524937.054344, 'last_price_update_time': 1774730204.584115}
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW78855') HTTP/1.1" 204 0
2026-03-28 20:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 20:36:44 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-28 20:36:44 [auto1.be] INFO: Scrape type for WS04459: 2
2026-03-28 20:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-28 20:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c4374bf-0d03-5ed8-bb70-d50388a9707d with scrape type 2
2026-03-28 20:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c4374bf-0d03-5ed8-bb70-d50388a9707d with scrape type 2
2026-03-28 20:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c4374bf-0d03-5ed8-bb70-d50388a9707d, identifier: WS04459
2026-03-28 20:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-28 20:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459
2026-03-28 20:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c4374bf-0d03-5ed8-bb70-d50388a9707d with identifier: WS04459 to the API
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:10:24Z',
 'fuel_type': 'diesel',
 'id': '1c4374bf-0d03-5ed8-bb70-d50388a9707d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS04459',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 180366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Exceed',
 'transmission': 'automatic',
 'trim': 'Exceed',
 'year': 2017}
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-28 20:36:45 [auto1.be] INFO: Saving data for WS04459: {'auction_closing_time': 1774883424.0, 'created_time': 1773434395.222802, 'last_price_update_time': 1774730205.241926}
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WS04459') HTTP/1.1" 204 0
2026-03-28 20:36:45 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 20:36:45 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-28 20:36:45 [auto1.be] INFO: Scrape type for KS43499: 2
2026-03-28 20:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-28 20:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with scrape type 2
2026-03-28 20:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with scrape type 2
2026-03-28 20:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08, identifier: KS43499
2026-03-28 20:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-28 20:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-28 20:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499 to the API
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:18Z',
 'fuel_type': 'diesel',
 'id': 'c1a8fcfc-4ac9-5924-a6e7-6309db30fa08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS43499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-28 20:36:45 [auto1.be] INFO: Saving data for KS43499: {'auction_closing_time': 1774885998.0, 'created_time': 1774524950.490951, 'last_price_update_time': 1774730205.762357}
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KS43499') HTTP/1.1" 204 0
2026-03-28 20:36:45 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-28 20:36:45 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-28 20:36:45 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-28 20:36:45 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-28 20:36:45 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-28 20:36:45 [auto1.be] INFO: Scrape type for HZ19238: 2
2026-03-28 20:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-28 20:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with scrape type 2
2026-03-28 20:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with scrape type 2
2026-03-28 20:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4ec37d8-52a1-5835-98e4-ea91f3cfd042, identifier: HZ19238
2026-03-28 20:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-28 20:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-28 20:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238 to the API
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:34:27Z',
 'fuel_type': 'diesel',
 'id': 'e4ec37d8-52a1-5835-98e4-ea91f3cfd042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ19238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 182429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-28 20:36:46 [auto1.be] INFO: Saving data for HZ19238: {'auction_closing_time': 1774884867.0, 'created_time': 1774524979.197727, 'last_price_update_time': 1774730206.243584}
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ19238') HTTP/1.1" 204 0
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-28 20:36:46 [auto1.be] INFO: Scrape type for AT20959: 1
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-28 20:36:46 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-28 20:36:46 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-28 20:36:46 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-28 20:36:46 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-28 20:36:46 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 20:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT20959/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:47 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1094 | hits on page: 40
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-28 20:36:47 [auto1.be] INFO: Scrape type for XJ24324: 0
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-28 20:36:47 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-28 20:36:47 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-28 20:36:47 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-28 20:36:47 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-28 20:36:47 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 20:36:47 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-28 20:36:47 [auto1.be] INFO: Scrape type for NN69701: 2
2026-03-28 20:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-28 20:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e9cd131-57c2-59bf-959c-55bb706fbfcd with scrape type 2
2026-03-28 20:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e9cd131-57c2-59bf-959c-55bb706fbfcd with scrape type 2
2026-03-28 20:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e9cd131-57c2-59bf-959c-55bb706fbfcd, identifier: NN69701
2026-03-28 20:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-28 20:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701
2026-03-28 20:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e9cd131-57c2-59bf-959c-55bb706fbfcd with identifier: NN69701 to the API
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:56:10Z',
 'fuel_type': 'diesel',
 'id': '7e9cd131-57c2-59bf-959c-55bb706fbfcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN69701',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 207612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-23',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-28 20:36:48 [auto1.be] INFO: Saving data for NN69701: {'auction_closing_time': 1774886170.0, 'created_time': 1774643742.489224, 'last_price_update_time': 1774730208.040537}
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN69701') HTTP/1.1" 204 0
2026-03-28 20:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-28 20:36:48 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-28 20:36:48 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-28 20:36:48 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-28 20:36:48 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-28 20:36:48 [auto1.be] INFO: Scrape type for FU04844: 2
2026-03-28 20:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-28 20:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c421c59-071e-592e-a41d-dd19b15f57db with scrape type 2
2026-03-28 20:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c421c59-071e-592e-a41d-dd19b15f57db with scrape type 2
2026-03-28 20:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c421c59-071e-592e-a41d-dd19b15f57db, identifier: FU04844
2026-03-28 20:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 20:36:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-28 20:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844 to the API
2026-03-28 20:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:37:41Z',
 'fuel_type': 'petrol',
 'id': '7c421c59-071e-592e-a41d-dd19b15f57db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU04844',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 127728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 FSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-28 20:36:49 [auto1.be] INFO: Saving data for FU04844: {'auction_closing_time': 1774885061.0, 'created_time': 1774524983.175024, 'last_price_update_time': 1774730209.524332}
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FU04844') HTTP/1.1" 204 0
2026-03-28 20:36:49 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-28 20:36:49 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-28 20:36:49 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-28 20:36:49 [auto1.be] INFO: Scrape type for UM95648: 2
2026-03-28 20:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-28 20:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eee887d9-6deb-5308-8e85-31dd9eb664cc with scrape type 2
2026-03-28 20:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eee887d9-6deb-5308-8e85-31dd9eb664cc with scrape type 2
2026-03-28 20:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eee887d9-6deb-5308-8e85-31dd9eb664cc, identifier: UM95648
2026-03-28 20:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-28 20:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-28 20:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648 to the API
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:30Z',
 'fuel_type': 'diesel',
 'id': 'eee887d9-6deb-5308-8e85-31dd9eb664cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM95648',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 165535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-02',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-28 20:36:49 [auto1.be] INFO: Saving data for UM95648: {'auction_closing_time': 1774884990.0, 'created_time': 1774524922.388539, 'last_price_update_time': 1774730209.965389}
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM95648') HTTP/1.1" 204 0
2026-03-28 20:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-28 20:36:50 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-28 20:36:50 [auto1.be] INFO: Scrape type for LG02466: 2
2026-03-28 20:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-28 20:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79734c8b-9629-5726-8cb7-c47685c96b21 with scrape type 2
2026-03-28 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79734c8b-9629-5726-8cb7-c47685c96b21 with scrape type 2
2026-03-28 20:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79734c8b-9629-5726-8cb7-c47685c96b21, identifier: LG02466
2026-03-28 20:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-28 20:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466
2026-03-28 20:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79734c8b-9629-5726-8cb7-c47685c96b21 with identifier: LG02466 to the API
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:51:39Z',
 'fuel_type': 'diesel',
 'id': '79734c8b-9629-5726-8cb7-c47685c96b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG02466',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 237146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2018}
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-28 20:36:50 [auto1.be] INFO: Saving data for LG02466: {'auction_closing_time': 1774885899.0, 'created_time': 1773239710.677546, 'last_price_update_time': 1774730210.433691}
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG02466') HTTP/1.1" 204 0
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-28 20:36:50 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-28 20:36:50 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-28 20:36:50 [auto1.be] INFO: Scrape type for VA33507: 2
2026-03-28 20:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-28 20:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9602a68-0826-50df-9626-ca57389c77f7 with scrape type 2
2026-03-28 20:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9602a68-0826-50df-9626-ca57389c77f7 with scrape type 2
2026-03-28 20:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9602a68-0826-50df-9626-ca57389c77f7, identifier: VA33507
2026-03-28 20:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-28 20:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507
2026-03-28 20:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9602a68-0826-50df-9626-ca57389c77f7 with identifier: VA33507 to the API
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:20Z',
 'fuel_type': 'diesel',
 'id': 'e9602a68-0826-50df-9626-ca57389c77f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA33507',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 179135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-28 20:36:50 [auto1.be] INFO: Saving data for VA33507: {'auction_closing_time': 1774883840.0, 'created_time': 1773138050.607634, 'last_price_update_time': 1774730210.963732}
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA33507') HTTP/1.1" 204 0
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 20:36:50 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 20:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-28 20:36:51 [auto1.be] INFO: Scrape type for LY58233: 2
2026-03-28 20:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-28 20:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e38bf0c-6944-5305-b783-d2f785623c95 with scrape type 2
2026-03-28 20:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e38bf0c-6944-5305-b783-d2f785623c95 with scrape type 2
2026-03-28 20:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e38bf0c-6944-5305-b783-d2f785623c95, identifier: LY58233
2026-03-28 20:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-28 20:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-28 20:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233 to the API
2026-03-28 20:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:43:02Z',
 'fuel_type': 'hybrid',
 'id': '4e38bf0c-6944-5305-b783-d2f785623c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY58233',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 190058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Saving data for LY58233: {'auction_closing_time': 1774885382.0, 'created_time': 1774524986.725315, 'last_price_update_time': 1774730212.051799}
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY58233') HTTP/1.1" 204 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-28 20:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:52 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1094 | hits on page: 40
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for PU90284: 2
2026-03-28 20:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-28 20:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with scrape type 2
2026-03-28 20:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with scrape type 2
2026-03-28 20:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8abb6001-164c-5d9d-9ae1-286dc8a366f2, identifier: PU90284
2026-03-28 20:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-28 20:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284
2026-03-28 20:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8abb6001-164c-5d9d-9ae1-286dc8a366f2 with identifier: PU90284 to the API
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:56Z',
 'fuel_type': 'petrol',
 'id': '8abb6001-164c-5d9d-9ae1-286dc8a366f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU90284',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Saving data for PU90284: {'auction_closing_time': 1774883696.0, 'created_time': 1773301732.687763, 'last_price_update_time': 1774730212.644818}
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PU90284') HTTP/1.1" 204 0
2026-03-28 20:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for HU17820: 1
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for NV75936: 1
2026-03-28 20:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT20959> (referer: https://www.auto1.com/v1/car-details-view/AT20959/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-28 20:36:52 [auto1.be] INFO: Scrape type for AW25378: 1
2026-03-28 20:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-28 20:36:52 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-28 20:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [auto1.be] INFO: Scrape type for LS82290: 1
2026-03-28 20:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:53 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-28 20:36:53 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [auto1.be] INFO: Scrape type for CM51817: 1
2026-03-28 20:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959
2026-03-28 20:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c663418-20d3-518c-bc61-1c9cda53c239 with scrape type 1
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c663418-20d3-518c-bc61-1c9cda53c239
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_d1e5369f3b4b12f2dca909588eb43490.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_d1e5369f3b4b12f2dca909588eb43490.jpg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_0fac6f45ecc995b69bc3454e9f772bc7.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_0fac6f45ecc995b69bc3454e9f772bc7.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_c8b3818ffb51a66a4aee06e2cfdbeb05.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_c8b3818ffb51a66a4aee06e2cfdbeb05.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_14f67a4474e86cc1bfd1583760f57d87.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_14f67a4474e86cc1bfd1583760f57d87.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_2e59984387542b1b8d985ec3c873b17f.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_2e59984387542b1b8d985ec3c873b17f.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_4206a61df7754f949b19e33b87ccc1b8.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_4206a61df7754f949b19e33b87ccc1b8.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_669606ffb765c581acd67ea0bb8fb451.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_669606ffb765c581acd67ea0bb8fb451.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_58cb57f0f5100db504356ca0b98f03b3.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_58cb57f0f5100db504356ca0b98f03b3.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_8611d192d03df7bff3ef72c497211715.jpeg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_8611d192d03df7bff3ef72c497211715.jpeg already downloaded
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F3d%252F7e3d8bccf67449043fc88bc86907eb3d%252Fpa%252FAT20959_a5019a7a229666bd83d24accb674e487.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_a5019a7a229666bd83d24accb674e487.jpg already downloaded
2026-03-28 20:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c663418-20d3-518c-bc61-1c9cda53c239, identifier: AT20959
2026-03-28 20:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959
2026-03-28 20:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959
2026-03-28 20:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c663418-20d3-518c-bc61-1c9cda53c239 with identifier: AT20959 to the API
2026-03-28 20:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AT20959>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:08:38Z',
 'fuel_type': 'diesel',
 'id': '2c663418-20d3-518c-bc61-1c9cda53c239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT20959',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 109002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_d1e5369f3b4b12f2dca909588eb43490.jpg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_0fac6f45ecc995b69bc3454e9f772bc7.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_c8b3818ffb51a66a4aee06e2cfdbeb05.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_14f67a4474e86cc1bfd1583760f57d87.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_2e59984387542b1b8d985ec3c873b17f.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_4206a61df7754f949b19e33b87ccc1b8.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_669606ffb765c581acd67ea0bb8fb451.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_58cb57f0f5100db504356ca0b98f03b3.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_8611d192d03df7bff3ef72c497211715.jpeg',
                'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_a5019a7a229666bd83d24accb674e487.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_d1e5369f3b4b12f2dca909588eb43490.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_0fac6f45ecc995b69bc3454e9f772bc7.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_c8b3818ffb51a66a4aee06e2cfdbeb05.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_14f67a4474e86cc1bfd1583760f57d87.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_2e59984387542b1b8d985ec3c873b17f.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_4206a61df7754f949b19e33b87ccc1b8.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_669606ffb765c581acd67ea0bb8fb451.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_58cb57f0f5100db504356ca0b98f03b3.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_8611d192d03df7bff3ef72c497211715.jpeg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c663418-20d3-518c-bc61-1c9cda53c239/2c663418-20d3-518c-bc61-1c9cda53c239_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/3d/7e3d8bccf67449043fc88bc86907eb3d/pa/AT20959_a5019a7a229666bd83d24accb674e487.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2015}
2026-03-28 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-28 20:36:54 [auto1.be] INFO: Saving data for AT20959: {'created_time': 1774730214.660005, 'last_price_update_time': 1774730214.660017, 'auction_closing_time': 1774883318.0}
2026-03-28 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AT20959') HTTP/1.1" 204 0
2026-03-28 20:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW25378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM51817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU17820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS82290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV75936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW25378> (referer: https://www.auto1.com/v1/car-details-view/AW25378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378
2026-03-28 20:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce with scrape type 1
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_f529c3dffcce3b043ed09a596408012e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_f529c3dffcce3b043ed09a596408012e.jpg not downloaded yet
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_98a14d3b96e52d8e56c6955beefa90f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_98a14d3b96e52d8e56c6955beefa90f6.jpg not downloaded yet
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_5ef4f448cbda2394d40cc5c74c714cf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_5ef4f448cbda2394d40cc5c74c714cf6.jpg not downloaded yet
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_60303ae4e30034ab7532e63a56e23e49.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_60303ae4e30034ab7532e63a56e23e49.jpg not downloaded yet
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_27e22f66b8c59fc911d23005cb51cd53.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_27e22f66b8c59fc911d23005cb51cd53.jpg not downloaded yet
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_a1fb7ac098235e52bd7740dc751434d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_a1fb7ac098235e52bd7740dc751434d0.jpg not downloaded yet
2026-03-28 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU17820> (referer: https://www.auto1.com/v1/car-details-view/HU17820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM51817> (referer: https://www.auto1.com/v1/car-details-view/CM51817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_a1fb7ac098235e52bd7740dc751434d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_98a14d3b96e52d8e56c6955beefa90f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_f529c3dffcce3b043ed09a596408012e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820
2026-03-28 20:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with scrape type 1
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_49f6ce786e68d9243ae4bab1e71800f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_49f6ce786e68d9243ae4bab1e71800f9.jpg not downloaded yet
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_07629a164153a900222cb935568dbd3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_07629a164153a900222cb935568dbd3d.jpg not downloaded yet
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_81223b11dd8d09f9ad2eb230de423ae9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_81223b11dd8d09f9ad2eb230de423ae9.jpg not downloaded yet
2026-03-28 20:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV75936> (referer: https://www.auto1.com/v1/car-details-view/NV75936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817
2026-03-28 20:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb6f833-2633-5bb6-b91b-a5472789db91 with scrape type 1
2026-03-28 20:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcb6f833-2633-5bb6-b91b-a5472789db91
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_355120a379657f4fbb8ba8ec1fc21156.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_355120a379657f4fbb8ba8ec1fc21156.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_f45f570c134916871654f50f5da252b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_f45f570c134916871654f50f5da252b1.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_b2d2a6c3d2deebbc613ea0203665b90c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_b2d2a6c3d2deebbc613ea0203665b90c.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_3fb0fd3c34358fe6949eddbf1ca8582a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_3fb0fd3c34358fe6949eddbf1ca8582a.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_e344a7141f791d6ad81d832f3b6532c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_e344a7141f791d6ad81d832f3b6532c1.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_ccfb1b8ea69dcf83222ca770a211fd41.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_ccfb1b8ea69dcf83222ca770a211fd41.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_e56e0099f2eb82d0e8d04df5b07823c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_e56e0099f2eb82d0e8d04df5b07823c7.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_3a4143f943a717143d2cff367db51726.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_3a4143f943a717143d2cff367db51726.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_4ab8881d02b896730213b974947d9830.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_4ab8881d02b896730213b974947d9830.jpg already downloaded
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F0c%252Ff90c8d89910a5fa7d136fd869b95949a%252Fpa%252FCM51817_54a290eab25d3b1d9315fc1dc3b4f6ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_54a290eab25d3b1d9315fc1dc3b4f6ec.jpg already downloaded
2026-03-28 20:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcb6f833-2633-5bb6-b91b-a5472789db91, identifier: CM51817
2026-03-28 20:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_60303ae4e30034ab7532e63a56e23e49.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_87d1bbcca3b0c32614f4c45f789db700.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_87d1bbcca3b0c32614f4c45f789db700.jpg not downloaded yet
2026-03-28 20:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817
2026-03-28 20:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817
2026-03-28 20:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcb6f833-2633-5bb6-b91b-a5472789db91 with identifier: CM51817 to the API
2026-03-28 20:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CM51817>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'diesel',
 'id': 'dcb6f833-2633-5bb6-b91b-a5472789db91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM51817',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 136045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_355120a379657f4fbb8ba8ec1fc21156.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_f45f570c134916871654f50f5da252b1.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_b2d2a6c3d2deebbc613ea0203665b90c.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_3fb0fd3c34358fe6949eddbf1ca8582a.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_e344a7141f791d6ad81d832f3b6532c1.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_ccfb1b8ea69dcf83222ca770a211fd41.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_e56e0099f2eb82d0e8d04df5b07823c7.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_3a4143f943a717143d2cff367db51726.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_4ab8881d02b896730213b974947d9830.jpg',
                'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_54a290eab25d3b1d9315fc1dc3b4f6ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_355120a379657f4fbb8ba8ec1fc21156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_f45f570c134916871654f50f5da252b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_b2d2a6c3d2deebbc613ea0203665b90c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_3fb0fd3c34358fe6949eddbf1ca8582a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_e344a7141f791d6ad81d832f3b6532c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_ccfb1b8ea69dcf83222ca770a211fd41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_e56e0099f2eb82d0e8d04df5b07823c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_3a4143f943a717143d2cff367db51726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_4ab8881d02b896730213b974947d9830.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb6f833-2633-5bb6-b91b-a5472789db91/dcb6f833-2633-5bb6-b91b-a5472789db91_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/0c/f90c8d89910a5fa7d136fd869b95949a/pa/CM51817_54a290eab25d3b1d9315fc1dc3b4f6ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2015}
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [auto1.be] INFO: Saving data for CM51817: {'created_time': 1774730218.400918, 'last_price_update_time': 1774730218.400934, 'auction_closing_time': 1774883752.0}
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM51817') HTTP/1.1" 204 0
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b38f90>
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_a1fb7ac098235e52bd7740dc751434d0.jpg') HTTP/1.1" 204 0
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_a1fb7ac098235e52bd7740dc751434d0.jpg saved to cache
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80312d010>
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_98a14d3b96e52d8e56c6955beefa90f6.jpg') HTTP/1.1" 204 0
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_98a14d3b96e52d8e56c6955beefa90f6.jpg saved to cache
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df19d0>
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_f529c3dffcce3b043ed09a596408012e.jpg') HTTP/1.1" 204 0
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_f529c3dffcce3b043ed09a596408012e.jpg saved to cache
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce
2026-03-28 20:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_49f6ce786e68d9243ae4bab1e71800f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_e6241fbfc7307cdca0c7af3885a08f98.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e6241fbfc7307cdca0c7af3885a08f98.jpg not downloaded yet
2026-03-28 20:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS82290> (referer: https://www.auto1.com/v1/car-details-view/LS82290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936
2026-03-28 20:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e987b171-1c55-5ba2-9698-9295cd6d0a23 with scrape type 1
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e987b171-1c55-5ba2-9698-9295cd6d0a23
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_9628dfaf9001efe573e65e9e9f664c0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_9628dfaf9001efe573e65e9e9f664c0d.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_6438a833cd25ebf7130ed373d311f215.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_6438a833cd25ebf7130ed373d311f215.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_8003421377dbce68c68e6b2427ce540b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_8003421377dbce68c68e6b2427ce540b.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_fba1959ad6fab73665b85bec8ef4259b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_fba1959ad6fab73665b85bec8ef4259b.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_c946a3ee23c5eddca315ef95e1e85a21.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_c946a3ee23c5eddca315ef95e1e85a21.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_3e7353126525d014ea59b5b6636d65d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_3e7353126525d014ea59b5b6636d65d7.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_bbc7b5b659935acf6fe8530ad2ab1340.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_bbc7b5b659935acf6fe8530ad2ab1340.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_5cdb99b9191da01bdac5d608ed5ff659.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_5cdb99b9191da01bdac5d608ed5ff659.jpg already downloaded
2026-03-28 20:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_c89c6a63cc16ef372950e2891b6b5dbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_c89c6a63cc16ef372950e2891b6b5dbe.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F8f%252F488f8540b49676fda17b7382e32c9f16%252Fpa%252FNV75936_291d7229af6a6dda6f4fdeb49288ba01.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_291d7229af6a6dda6f4fdeb49288ba01.jpg already downloaded
2026-03-28 20:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e987b171-1c55-5ba2-9698-9295cd6d0a23, identifier: NV75936
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80312f510>
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_60303ae4e30034ab7532e63a56e23e49.jpg') HTTP/1.1" 204 0
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_60303ae4e30034ab7532e63a56e23e49.jpg saved to cache
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce
2026-03-28 20:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_07629a164153a900222cb935568dbd3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_c63dad049599c246801fa17615527d39.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_c63dad049599c246801fa17615527d39.jpg not downloaded yet
2026-03-28 20:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936
2026-03-28 20:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936
2026-03-28 20:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e987b171-1c55-5ba2-9698-9295cd6d0a23 with identifier: NV75936 to the API
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV75936>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:14:09Z',
 'fuel_type': 'diesel',
 'id': 'e987b171-1c55-5ba2-9698-9295cd6d0a23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV75936',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 82166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_9628dfaf9001efe573e65e9e9f664c0d.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_6438a833cd25ebf7130ed373d311f215.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_8003421377dbce68c68e6b2427ce540b.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_fba1959ad6fab73665b85bec8ef4259b.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_c946a3ee23c5eddca315ef95e1e85a21.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_3e7353126525d014ea59b5b6636d65d7.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_bbc7b5b659935acf6fe8530ad2ab1340.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_5cdb99b9191da01bdac5d608ed5ff659.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_c89c6a63cc16ef372950e2891b6b5dbe.jpg',
                'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_291d7229af6a6dda6f4fdeb49288ba01.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_9628dfaf9001efe573e65e9e9f664c0d.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_6438a833cd25ebf7130ed373d311f215.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_8003421377dbce68c68e6b2427ce540b.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_fba1959ad6fab73665b85bec8ef4259b.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_c946a3ee23c5eddca315ef95e1e85a21.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_3e7353126525d014ea59b5b6636d65d7.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_bbc7b5b659935acf6fe8530ad2ab1340.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_5cdb99b9191da01bdac5d608ed5ff659.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_c89c6a63cc16ef372950e2891b6b5dbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e987b171-1c55-5ba2-9698-9295cd6d0a23/e987b171-1c55-5ba2-9698-9295cd6d0a23_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/8f/488f8540b49676fda17b7382e32c9f16/pa/NV75936_291d7229af6a6dda6f4fdeb49288ba01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium L2',
 'transmission': 'manual',
 'trim': 'Premium L2',
 'year': 2022}
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [auto1.be] INFO: Saving data for NV75936: {'created_time': 1774730219.483211, 'last_price_update_time': 1774730219.483222, 'auction_closing_time': 1774883649.0}
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV75936') HTTP/1.1" 204 0
2026-03-28 20:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_81223b11dd8d09f9ad2eb230de423ae9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_41d19eea3f3130cf124e83edf7fd9216.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_41d19eea3f3130cf124e83edf7fd9216.jpg not downloaded yet
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c8ec10>
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_49f6ce786e68d9243ae4bab1e71800f9.jpg') HTTP/1.1" 204 0
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_49f6ce786e68d9243ae4bab1e71800f9.jpg saved to cache
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290
2026-03-28 20:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0a7bd18-5699-5f63-8c35-900f8c09917a with scrape type 1
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0a7bd18-5699-5f63-8c35-900f8c09917a
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_d378382b6f10dc20840fcee4fdeb8f94.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_d378382b6f10dc20840fcee4fdeb8f94.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_445ae93dddbd8704233b431b431b07f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_445ae93dddbd8704233b431b431b07f7.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_4ac314ade128ca1f7b0f070ecaba8874.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_4ac314ade128ca1f7b0f070ecaba8874.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_bf8ca365675935459a12236ca3893597.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_bf8ca365675935459a12236ca3893597.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_59a5af4f2ad8a8c8f234297f5327043d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_59a5af4f2ad8a8c8f234297f5327043d.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_6de2433661af9cf52624f50ea73fdb93.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_6de2433661af9cf52624f50ea73fdb93.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_92db65fa21f3c906ef72185c47212962.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_92db65fa21f3c906ef72185c47212962.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_61169fd075b5d93a10cf1a77905879ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_61169fd075b5d93a10cf1a77905879ae.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_7326473d0aa0217da849153bb08aa9bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_7326473d0aa0217da849153bb08aa9bf.jpg already downloaded
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F4b%252F374bffc59bbd73a2b75604452b4fec3b%252Fpa%252FLS82290_72a0c324073f386cc2ee892409d3dc69.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_72a0c324073f386cc2ee892409d3dc69.jpg already downloaded
2026-03-28 20:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0a7bd18-5699-5f63-8c35-900f8c09917a, identifier: LS82290
2026-03-28 20:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290
2026-03-28 20:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290
2026-03-28 20:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0a7bd18-5699-5f63-8c35-900f8c09917a with identifier: LS82290 to the API
2026-03-28 20:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LS82290>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:42Z',
 'fuel_type': 'petrol',
 'id': 'b0a7bd18-5699-5f63-8c35-900f8c09917a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS82290',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 74189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_d378382b6f10dc20840fcee4fdeb8f94.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_445ae93dddbd8704233b431b431b07f7.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_4ac314ade128ca1f7b0f070ecaba8874.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_bf8ca365675935459a12236ca3893597.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_59a5af4f2ad8a8c8f234297f5327043d.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_6de2433661af9cf52624f50ea73fdb93.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_92db65fa21f3c906ef72185c47212962.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_61169fd075b5d93a10cf1a77905879ae.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_7326473d0aa0217da849153bb08aa9bf.jpg',
                'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_72a0c324073f386cc2ee892409d3dc69.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1912700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_d378382b6f10dc20840fcee4fdeb8f94.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_445ae93dddbd8704233b431b431b07f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_4ac314ade128ca1f7b0f070ecaba8874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_bf8ca365675935459a12236ca3893597.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_59a5af4f2ad8a8c8f234297f5327043d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_6de2433661af9cf52624f50ea73fdb93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2128147,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_92db65fa21f3c906ef72185c47212962.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_61169fd075b5d93a10cf1a77905879ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_7326473d0aa0217da849153bb08aa9bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0a7bd18-5699-5f63-8c35-900f8c09917a/b0a7bd18-5699-5f63-8c35-900f8c09917a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/4b/374bffc59bbd73a2b75604452b4fec3b/pa/LS82290_72a0c324073f386cc2ee892409d3dc69.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Longitude 4x2',
 'transmission': 'automatic',
 'trim': 'Longitude 4x2',
 'year': 2020}
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-28 20:37:01 [auto1.be] INFO: Saving data for LS82290: {'created_time': 1774730221.457827, 'last_price_update_time': 1774730221.457839, 'auction_closing_time': 1774886202.0}
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LS82290') HTTP/1.1" 204 0
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a95d50>
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_07629a164153a900222cb935568dbd3d.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_07629a164153a900222cb935568dbd3d.jpg saved to cache
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e6241fbfc7307cdca0c7af3885a08f98.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_e2c2d460817264637b5f35246041fe93.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e2c2d460817264637b5f35246041fe93.jpg not downloaded yet
2026-03-28 20:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_27e22f66b8c59fc911d23005cb51cd53.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_5ef4f448cbda2394d40cc5c74c714cf6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b6eb10>
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_81223b11dd8d09f9ad2eb230de423ae9.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_81223b11dd8d09f9ad2eb230de423ae9.jpg saved to cache
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_b529609f54da11693bff5f6f7a25d08c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_b529609f54da11693bff5f6f7a25d08c.jpg not downloaded yet
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_cf5c2362c489177e7279502e2bc3f5cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_cf5c2362c489177e7279502e2bc3f5cd.jpg not downloaded yet
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b50ad0>
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_e6241fbfc7307cdca0c7af3885a08f98.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e6241fbfc7307cdca0c7af3885a08f98.jpg saved to cache
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b93290>
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_27e22f66b8c59fc911d23005cb51cd53.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_27e22f66b8c59fc911d23005cb51cd53.jpg saved to cache
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80312d750>
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fec%252Ff6ecb1c417d45100edd78c82c3a53f7a%252Fpa%252FAW25378_5ef4f448cbda2394d40cc5c74c714cf6.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_5ef4f448cbda2394d40cc5c74c714cf6.jpg saved to cache
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce
2026-03-28 20:37:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d4fb1c7-c573-568e-8b4d-3519d53218ce, skipping ID generation
2026-03-28 20:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce with scrape type 1
2026-03-28 20:37:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d4fb1c7-c573-568e-8b4d-3519d53218ce sending to next pipeline
2026-03-28 20:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d4fb1c7-c573-568e-8b4d-3519d53218ce, identifier: AW25378
2026-03-28 20:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378
2026-03-28 20:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378
2026-03-28 20:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d4fb1c7-c573-568e-8b4d-3519d53218ce with identifier: AW25378 to the API
2026-03-28 20:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_5ef4f448cbda2394d40cc5c74c714cf6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:08Z',
 'fuel_type': 'petrol',
 'id': '3d4fb1c7-c573-568e-8b4d-3519d53218ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW25378',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 169392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_f529c3dffcce3b043ed09a596408012e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_98a14d3b96e52d8e56c6955beefa90f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_5ef4f448cbda2394d40cc5c74c714cf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_60303ae4e30034ab7532e63a56e23e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_27e22f66b8c59fc911d23005cb51cd53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4fb1c7-c573-568e-8b4d-3519d53218ce/3d4fb1c7-c573-568e-8b4d-3519d53218ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/ec/f6ecb1c417d45100edd78c82c3a53f7a/pa/AW25378_a1fb7ac098235e52bd7740dc751434d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-28 20:37:02 [auto1.be] INFO: Saving data for AW25378: {'created_time': 1774730222.257239, 'last_price_update_time': 1774730222.257251, 'auction_closing_time': 1774884848.0}
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AW25378') HTTP/1.1" 204 0
2026-03-28 20:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_c63dad049599c246801fa17615527d39.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_41d19eea3f3130cf124e83edf7fd9216.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e2c2d460817264637b5f35246041fe93.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_87d1bbcca3b0c32614f4c45f789db700.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_cf5c2362c489177e7279502e2bc3f5cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_b529609f54da11693bff5f6f7a25d08c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80313ca50>
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_c63dad049599c246801fa17615527d39.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_c63dad049599c246801fa17615527d39.jpg saved to cache
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80313cdd0>
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_41d19eea3f3130cf124e83edf7fd9216.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_41d19eea3f3130cf124e83edf7fd9216.jpg saved to cache
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b14490>
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_e2c2d460817264637b5f35246041fe93.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e2c2d460817264637b5f35246041fe93.jpg saved to cache
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a58b50>
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_87d1bbcca3b0c32614f4c45f789db700.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_87d1bbcca3b0c32614f4c45f789db700.jpg saved to cache
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811afc150>
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_cf5c2362c489177e7279502e2bc3f5cd.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_cf5c2362c489177e7279502e2bc3f5cd.jpg saved to cache
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a76f50>
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Ff3%252F82f3b16e3c42d1d30aa04fdcca0cddc8%252Fpa%252FHU17820_b529609f54da11693bff5f6f7a25d08c.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_b529609f54da11693bff5f6f7a25d08c.jpg saved to cache
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526
2026-03-28 20:37:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e303cf21-b14a-5dac-b1c9-cb7c7fec6526, skipping ID generation
2026-03-28 20:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with scrape type 1
2026-03-28 20:37:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e303cf21-b14a-5dac-b1c9-cb7c7fec6526 sending to next pipeline
2026-03-28 20:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e303cf21-b14a-5dac-b1c9-cb7c7fec6526, identifier: HU17820
2026-03-28 20:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820
2026-03-28 20:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820
2026-03-28 20:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e303cf21-b14a-5dac-b1c9-cb7c7fec6526 with identifier: HU17820 to the API
2026-03-28 20:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_b529609f54da11693bff5f6f7a25d08c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'petrol',
 'id': 'e303cf21-b14a-5dac-b1c9-cb7c7fec6526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU17820',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 82386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_49f6ce786e68d9243ae4bab1e71800f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_07629a164153a900222cb935568dbd3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_81223b11dd8d09f9ad2eb230de423ae9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_87d1bbcca3b0c32614f4c45f789db700.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e6241fbfc7307cdca0c7af3885a08f98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_c63dad049599c246801fa17615527d39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_41d19eea3f3130cf124e83edf7fd9216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_e2c2d460817264637b5f35246041fe93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_b529609f54da11693bff5f6f7a25d08c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e303cf21-b14a-5dac-b1c9-cb7c7fec6526/e303cf21-b14a-5dac-b1c9-cb7c7fec6526_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2685630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img82/f3/82f3b16e3c42d1d30aa04fdcca0cddc8/pa/HU17820_cf5c2362c489177e7279502e2bc3f5cd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-28 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-28 20:37:03 [auto1.be] INFO: Saving data for HU17820: {'created_time': 1774730223.347914, 'last_price_update_time': 1774730223.347926, 'auction_closing_time': 1774885296.0}
2026-03-28 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU17820') HTTP/1.1" 204 0
2026-03-28 20:37:06 [scrapy.extensions.logstats] INFO: Crawled 58 pages (at 17 pages/min), scraped 70 items (at 23 items/min)
2026-03-28 20:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 172MiB
2026-03-28 20:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:25 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1094 | hits on page: 40
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: FA04427
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: NJ37001
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-28 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-28 20:37:25 [auto1.be] INFO: Scrape type for RD23593: 1
2026-03-28 20:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-28 20:37:25 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-28 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-28 20:37:25 [auto1.be] INFO: Scrape type for GD95033: 2
2026-03-28 20:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033
2026-03-28 20:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb5e8535-2625-510e-88b3-3698b3a44caa with scrape type 2
2026-03-28 20:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb5e8535-2625-510e-88b3-3698b3a44caa with scrape type 2
2026-03-28 20:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb5e8535-2625-510e-88b3-3698b3a44caa, identifier: GD95033
2026-03-28 20:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033
2026-03-28 20:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033
2026-03-28 20:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb5e8535-2625-510e-88b3-3698b3a44caa with identifier: GD95033 to the API
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:55:23Z',
 'fuel_type': 'diesel',
 'id': 'cb5e8535-2625-510e-88b3-3698b3a44caa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD95033',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 161347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Iveco Daily 3.0 Diesel GKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'GKa 35 S V Radstand 3520 L',
 'year': 2019}
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Saving data for GD95033: {'auction_closing_time': 1774886123.0, 'created_time': 1774039029.543389, 'last_price_update_time': 1774730246.311736}
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GD95033') HTTP/1.1" 204 0
2026-03-28 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Scrape type for LG99308: 1
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Scrape type for KW17867: 1
2026-03-28 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Scrape type for HS15781: 1
2026-03-28 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Scrape type for HT80629: 1
2026-03-28 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Scrape type for FT23017: 1
2026-03-28 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Scrape type for MY75694: 1
2026-03-28 20:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:26 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-28 20:37:26 [auto1.be] INFO: Scrape type for LH19076: 2
2026-03-28 20:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076
2026-03-28 20:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with scrape type 2
2026-03-28 20:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with scrape type 2
2026-03-28 20:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c, identifier: LH19076
2026-03-28 20:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076
2026-03-28 20:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076
2026-03-28 20:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c with identifier: LH19076 to the API
2026-03-28 20:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:04:09Z',
 'fuel_type': 'petrol',
 'id': '3ca42d8d-43cd-5f5e-ad0b-ff5cab10b80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH19076',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 131198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-02',
 'seller_name': None,
 'title': 'Renault Scenic 2.0 Exception',
 'transmission': 'automatic',
 'trim': 'Exception',
 'year': 2007}
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Saving data for LH19076: {'auction_closing_time': 1774883049.0, 'created_time': 1773384094.854703, 'last_price_update_time': 1774730247.166383}
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH19076') HTTP/1.1" 204 0
2026-03-28 20:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for TF49476: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for FT86060: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for JT63704: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for SX16585: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for TF43790: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for LF44164: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for SV00163: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for VM07385: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-28 20:37:27 [auto1.be] INFO: Scrape type for WC19794: 1
2026-03-28 20:37:27 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-28 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD23593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS15781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT23017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:28 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1094 | hits on page: 40
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-28 20:37:28 [auto1.be] INFO: Scrape type for SB51494: 1
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-28 20:37:28 [auto1.be] INFO: Scrape type for KM81672: 1
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-28 20:37:28 [auto1.be] INFO: Scrape type for JC37428: 2
2026-03-28 20:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428
2026-03-28 20:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11094b10-aa66-5d7c-9047-d570a681a7b4 with scrape type 2
2026-03-28 20:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11094b10-aa66-5d7c-9047-d570a681a7b4 with scrape type 2
2026-03-28 20:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11094b10-aa66-5d7c-9047-d570a681a7b4, identifier: JC37428
2026-03-28 20:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428
2026-03-28 20:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428
2026-03-28 20:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11094b10-aa66-5d7c-9047-d570a681a7b4 with identifier: JC37428 to the API
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:53Z',
 'fuel_type': 'diesel',
 'id': '11094b10-aa66-5d7c-9047-d570a681a7b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC37428',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 287390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-21',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Tomtom Edition',
 'transmission': 'manual',
 'trim': 'Tomtom Edition',
 'year': 2010}
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-28 20:37:28 [auto1.be] INFO: Saving data for JC37428: {'auction_closing_time': 1774883753.0, 'created_time': 1774039014.735276, 'last_price_update_time': 1774730248.84748}
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC37428') HTTP/1.1" 204 0
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-28 20:37:28 [auto1.be] INFO: Scrape type for BT48733: 1
2026-03-28 20:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG99308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:28 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-28 20:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for JM52918: 1
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT80629/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY75694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW17867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF49476/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for PJ47204: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for WV93881: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for WV93759: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for HZ76034: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: US61524
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for US61524: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for WJ93890: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for DN00999: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for ZW40078: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for YW96446: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-28 20:37:29 [auto1.be] INFO: Scrape type for UE64828: 1
2026-03-28 20:37:29 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT86060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF43790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV00163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC19794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX16585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF44164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD23593> (referer: https://www.auto1.com/v1/car-details-view/RD23593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593
2026-03-28 20:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e with scrape type 1
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_4267a88c77dcab48f1e9b4544d7b5d21.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4267a88c77dcab48f1e9b4544d7b5d21.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_5f2aadf0175f0caed2a19a4c508a2cda.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_5f2aadf0175f0caed2a19a4c508a2cda.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_3297601c307cfa638810c9fe6b85479f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_3297601c307cfa638810c9fe6b85479f.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_af768f645a53d5b50cea88dc26e602f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_af768f645a53d5b50cea88dc26e602f6.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_045ad9fbae97956b4cc79cfa6273b45f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_045ad9fbae97956b4cc79cfa6273b45f.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_8327f6610f538cb0b42ed1fafd881ca2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_8327f6610f538cb0b42ed1fafd881ca2.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_0a530b65e2eaa837778ac5becaaf4e08.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_0a530b65e2eaa837778ac5becaaf4e08.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_7869e18e4ed11d8fa6ecdecc3d105dcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_7869e18e4ed11d8fa6ecdecc3d105dcf.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_4184dde84e025d2e1f35fef030716d6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4184dde84e025d2e1f35fef030716d6d.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_4ec3a04e8bb1350811d13382eaf7e12d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4ec3a04e8bb1350811d13382eaf7e12d.jpg not downloaded yet
2026-03-28 20:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS15781> (referer: https://www.auto1.com/v1/car-details-view/HS15781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4ec3a04e8bb1350811d13382eaf7e12d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781
2026-03-28 20:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b2552a-3753-5935-b5aa-78022f00079d with scrape type 1
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_7d63cc81945ece8eb4b5987b34040713.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_7d63cc81945ece8eb4b5987b34040713.jpg not downloaded yet
2026-03-28 20:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4184dde84e025d2e1f35fef030716d6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_e0eb869327202272108c720c6fc039fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_e0eb869327202272108c720c6fc039fe.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_776b579386013ae80fb4c012327f6d31.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_776b579386013ae80fb4c012327f6d31.jpg not downloaded yet
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_930314ca0b929890fd1ef2222a86baa5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_930314ca0b929890fd1ef2222a86baa5.jpg not downloaded yet
2026-03-28 20:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ccb1d0>
2026-03-28 20:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_4ec3a04e8bb1350811d13382eaf7e12d.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4ec3a04e8bb1350811d13382eaf7e12d.jpg saved to cache
2026-03-28 20:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_9f93308d0014943eb709c97a3422814c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_9f93308d0014943eb709c97a3422814c.jpg not downloaded yet
2026-03-28 20:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_7d63cc81945ece8eb4b5987b34040713.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM52918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_f8e6b545850e18d145727b2fc8f66365.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f8e6b545850e18d145727b2fc8f66365.jpg not downloaded yet
2026-03-28 20:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b0d850>
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_4184dde84e025d2e1f35fef030716d6d.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4184dde84e025d2e1f35fef030716d6d.jpg saved to cache
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_0f203b45c33e213d9f94649990bb25e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_0f203b45c33e213d9f94649990bb25e7.jpg not downloaded yet
2026-03-28 20:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT48733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT23017> (referer: https://www.auto1.com/v1/car-details-view/FT23017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b6e990>
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_7d63cc81945ece8eb4b5987b34040713.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_7d63cc81945ece8eb4b5987b34040713.jpg saved to cache
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_833e320c41a17353ce587a1e152ee41c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_833e320c41a17353ce587a1e152ee41c.jpg not downloaded yet
2026-03-28 20:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_941be155b48daab5cbbb6b0adda66327.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_941be155b48daab5cbbb6b0adda66327.jpg not downloaded yet
2026-03-28 20:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM81672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_f9fc56753735728503dc4a30d0a8b0ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f9fc56753735728503dc4a30d0a8b0ca.jpg not downloaded yet
2026-03-28 20:37:31 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1094 | hits on page: 40
2026-03-28 20:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017
2026-03-28 20:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01cd576d-046c-5518-ad4a-9db2edde1ad5 with scrape type 1
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01cd576d-046c-5518-ad4a-9db2edde1ad5
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_5b778e1dced17bdd08725a9d490b896d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_5b778e1dced17bdd08725a9d490b896d.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_6eb10ab2fe38b0c5a3ad26cd2506b390.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_6eb10ab2fe38b0c5a3ad26cd2506b390.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_972131af2d972e1c3e195cc8f894ce21.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_972131af2d972e1c3e195cc8f894ce21.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_4dc336fbacc18ad721809a78ec597202.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_4dc336fbacc18ad721809a78ec597202.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_6f2e1c74a9bbadc0e9842dc5c705473a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_6f2e1c74a9bbadc0e9842dc5c705473a.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_ee9284b2bd01b82af0eee3aed5a7fed8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_ee9284b2bd01b82af0eee3aed5a7fed8.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_972a0b7fa67b1a28a4b310afa111da4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_972a0b7fa67b1a28a4b310afa111da4c.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_c72971bb874688abf13f2e1cec273d21.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_c72971bb874688abf13f2e1cec273d21.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_f70545aecf25cc3285897a06b519046b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_f70545aecf25cc3285897a06b519046b.jpg already downloaded
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fbe%252F5dbe0b9c4f7b86f91ac57f9bf00cfb5d%252Fpa%252FFT23017_cb281ea00faf4f18e480d55ad7d81a8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_cb281ea00faf4f18e480d55ad7d81a8d.jpg already downloaded
2026-03-28 20:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01cd576d-046c-5518-ad4a-9db2edde1ad5, identifier: FT23017
2026-03-28 20:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017
2026-03-28 20:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017
2026-03-28 20:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01cd576d-046c-5518-ad4a-9db2edde1ad5 with identifier: FT23017 to the API
2026-03-28 20:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FT23017>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:35Z',
 'fuel_type': 'diesel',
 'id': '01cd576d-046c-5518-ad4a-9db2edde1ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT23017',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 173043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_5b778e1dced17bdd08725a9d490b896d.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_6eb10ab2fe38b0c5a3ad26cd2506b390.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_972131af2d972e1c3e195cc8f894ce21.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_4dc336fbacc18ad721809a78ec597202.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_6f2e1c74a9bbadc0e9842dc5c705473a.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_ee9284b2bd01b82af0eee3aed5a7fed8.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_972a0b7fa67b1a28a4b310afa111da4c.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_c72971bb874688abf13f2e1cec273d21.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_f70545aecf25cc3285897a06b519046b.jpg',
                'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_cb281ea00faf4f18e480d55ad7d81a8d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_5b778e1dced17bdd08725a9d490b896d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_6eb10ab2fe38b0c5a3ad26cd2506b390.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_972131af2d972e1c3e195cc8f894ce21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_4dc336fbacc18ad721809a78ec597202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_6f2e1c74a9bbadc0e9842dc5c705473a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_ee9284b2bd01b82af0eee3aed5a7fed8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653180,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_972a0b7fa67b1a28a4b310afa111da4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_c72971bb874688abf13f2e1cec273d21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_f70545aecf25cc3285897a06b519046b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01cd576d-046c-5518-ad4a-9db2edde1ad5/01cd576d-046c-5518-ad4a-9db2edde1ad5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/be/5dbe0b9c4f7b86f91ac57f9bf00cfb5d/pa/FT23017_cb281ea00faf4f18e480d55ad7d81a8d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi 60 Jahre 4x4',
 'transmission': 'manual',
 'trim': '60 Jahre 4x4',
 'year': 2012}
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Saving data for FT23017: {'created_time': 1774730252.114162, 'last_price_update_time': 1774730252.114175, 'auction_closing_time': 1774884335.0}
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT23017') HTTP/1.1" 204 0
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Scrape type for KF94293: 1
2026-03-28 20:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_776b579386013ae80fb4c012327f6d31.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_0f203b45c33e213d9f94649990bb25e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_833e320c41a17353ce587a1e152ee41c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Scrape type for LM13926: 1
2026-03-28 20:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB51494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Scrape type for AE63964: 1
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Scrape type for SL57288: 2
2026-03-28 20:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288
2026-03-28 20:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58835f8b-49e1-5b95-ab54-d689049ca436 with scrape type 2
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58835f8b-49e1-5b95-ab54-d689049ca436 with scrape type 2
2026-03-28 20:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58835f8b-49e1-5b95-ab54-d689049ca436, identifier: SL57288
2026-03-28 20:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288
2026-03-28 20:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288
2026-03-28 20:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58835f8b-49e1-5b95-ab54-d689049ca436 with identifier: SL57288 to the API
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:35:42Z',
 'fuel_type': 'diesel',
 'id': '58835f8b-49e1-5b95-ab54-d689049ca436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL57288',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 82500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Jaguar XJ 3.0 D V6 Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2011}
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Saving data for SL57288: {'auction_closing_time': 1774884942.0, 'created_time': 1773351497.729516, 'last_price_update_time': 1774730252.694687}
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL57288') HTTP/1.1" 204 0
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Scrape type for RK43455: 1
2026-03-28 20:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f9fc56753735728503dc4a30d0a8b0ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-28 20:37:32 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-28 20:37:32 [auto1.be] INFO: Scrape type for FB93927: 2
2026-03-28 20:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927
2026-03-28 20:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with scrape type 2
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with scrape type 2
2026-03-28 20:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23, identifier: FB93927
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bcce90>
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_776b579386013ae80fb4c012327f6d31.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_776b579386013ae80fb4c012327f6d31.jpg saved to cache
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c73390>
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_0f203b45c33e213d9f94649990bb25e7.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_0f203b45c33e213d9f94649990bb25e7.jpg saved to cache
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bdd050>
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_833e320c41a17353ce587a1e152ee41c.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_833e320c41a17353ce587a1e152ee41c.jpg saved to cache
2026-03-28 20:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927
2026-03-28 20:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927
2026-03-28 20:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18bd56cb-22cf-5c76-bd47-4f6893cd7b23 with identifier: FB93927 to the API
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:28:34Z',
 'fuel_type': 'petrol',
 'id': '18bd56cb-22cf-5c76-bd47-4f6893cd7b23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB93927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 7188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 Mild-Hybrid 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2024}
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-28 20:37:33 [auto1.be] INFO: Saving data for FB93927: {'auction_closing_time': 1774884514.0, 'created_time': 1773384628.77735, 'last_price_update_time': 1774730253.312419}
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FB93927') HTTP/1.1" 204 0
2026-03-28 20:37:33 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-28 20:37:33 [auto1.be] INFO: Scrape type for SV46049: 2
2026-03-28 20:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049
2026-03-28 20:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeee6ef-1a80-5b7b-a120-43a05c9df56f with scrape type 2
2026-03-28 20:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeee6ef-1a80-5b7b-a120-43a05c9df56f with scrape type 2
2026-03-28 20:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeee6ef-1a80-5b7b-a120-43a05c9df56f, identifier: SV46049
2026-03-28 20:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049
2026-03-28 20:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049
2026-03-28 20:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeee6ef-1a80-5b7b-a120-43a05c9df56f with identifier: SV46049 to the API
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 126,
 'expiration_date': '2026-03-30T15:30:16Z',
 'fuel_type': 'petrol',
 'id': 'deeee6ef-1a80-5b7b-a120-43a05c9df56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV46049',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 157744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-15',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2019}
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-28 20:37:33 [auto1.be] INFO: Saving data for SV46049: {'auction_closing_time': 1774884616.0, 'created_time': 1774006556.233853, 'last_price_update_time': 1774730253.777129}
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV46049') HTTP/1.1" 204 0
2026-03-28 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW40078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT86060> (referer: https://www.auto1.com/v1/car-details-view/FT86060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:33 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-28 20:37:33 [auto1.be] INFO: Scrape type for WV65314: 1
2026-03-28 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE64828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b2df50>
2026-03-28 20:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_f9fc56753735728503dc4a30d0a8b0ca.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f9fc56753735728503dc4a30d0a8b0ca.jpg saved to cache
2026-03-28 20:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:33 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-28 20:37:33 [auto1.be] INFO: Scrape type for FM81572: 1
2026-03-28 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF43790> (referer: https://www.auto1.com/v1/car-details-view/TF43790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW96446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:33 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-28 20:37:33 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for MW50956: 1
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for DN28044: 1
2026-03-28 20:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060
2026-03-28 20:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with scrape type 1
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_bfd9ab9ec4395a86541c88830e2c60da.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_bfd9ab9ec4395a86541c88830e2c60da.jpg not downloaded yet
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for WG38275: 1
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_862c044a5a65200ad85cb3a0f4b8d765.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_862c044a5a65200ad85cb3a0f4b8d765.jpg not downloaded yet
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for NC08569: 1
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_b190fed386b82412fe179525edfe42c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_b190fed386b82412fe179525edfe42c3.jpg not downloaded yet
2026-03-28 20:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790
2026-03-28 20:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a70cb9-5cef-5226-a478-6868bba028a7 with scrape type 1
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_29c247e6ee8b1f5e37c28346f6fb995a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_29c247e6ee8b1f5e37c28346f6fb995a.jpg not downloaded yet
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for CF30779: 1
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_3923be48f1e5f2e7c69edaddfc9fd9fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_3923be48f1e5f2e7c69edaddfc9fd9fe.jpg not downloaded yet
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_7e27bfed9d58787a1175ae92e9dac49e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_7e27bfed9d58787a1175ae92e9dac49e.jpg not downloaded yet
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for WT53046: 1
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_d1e7cbb2ee14a88c4b57c85134e35b72.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_d1e7cbb2ee14a88c4b57c85134e35b72.jpg not downloaded yet
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_525a495dc716ec6d96a7293f238c7d24.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_525a495dc716ec6d96a7293f238c7d24.jpg not downloaded yet
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for DR48094: 1
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_a6b7374a3ed3fc4882681a9103e5a574.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_a6b7374a3ed3fc4882681a9103e5a574.jpg not downloaded yet
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_141f60cef8a1ad5ba1b90a23e0fb6faa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_141f60cef8a1ad5ba1b90a23e0fb6faa.jpg not downloaded yet
2026-03-28 20:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_930314ca0b929890fd1ef2222a86baa5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for JZ34939: 2
2026-03-28 20:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939
2026-03-28 20:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b8cd90-df8b-5835-a6e3-504455c8285b with scrape type 2
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02b8cd90-df8b-5835-a6e3-504455c8285b with scrape type 2
2026-03-28 20:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 02b8cd90-df8b-5835-a6e3-504455c8285b, identifier: JZ34939
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_7526189e9b26a6e157ec89806473064a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_7526189e9b26a6e157ec89806473064a.jpg not downloaded yet
2026-03-28 20:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939
2026-03-28 20:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939
2026-03-28 20:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 02b8cd90-df8b-5835-a6e3-504455c8285b with identifier: JZ34939 to the API
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'diesel',
 'id': '02b8cd90-df8b-5835-a6e3-504455c8285b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ34939',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 198065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2017}
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Saving data for JZ34939: {'auction_closing_time': 1774885120.0, 'created_time': 1773384097.361093, 'last_price_update_time': 1774730254.829381}
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ34939') HTTP/1.1" 204 0
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_6bbb4c89563b12d04f333369af4b635f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_6bbb4c89563b12d04f333369af4b635f.jpg not downloaded yet
2026-03-28 20:37:34 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-28 20:37:34 [auto1.be] INFO: Scrape type for TX04561: 2
2026-03-28 20:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561
2026-03-28 20:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abae9bda-841d-555b-bbc5-bed535ae796f with scrape type 2
2026-03-28 20:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abae9bda-841d-555b-bbc5-bed535ae796f with scrape type 2
2026-03-28 20:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abae9bda-841d-555b-bbc5-bed535ae796f, identifier: TX04561
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_442359ddec158ebcc1c14da209c09612.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_442359ddec158ebcc1c14da209c09612.jpg not downloaded yet
2026-03-28 20:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561
2026-03-28 20:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561
2026-03-28 20:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abae9bda-841d-555b-bbc5-bed535ae796f with identifier: TX04561 to the API
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:04:39Z',
 'fuel_type': 'diesel',
 'id': 'abae9bda-841d-555b-bbc5-bed535ae796f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX04561',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 200350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-07',
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [auto1.be] INFO: Saving data for TX04561: {'auction_closing_time': 1774883079.0, 'created_time': 1773995761.034204, 'last_price_update_time': 1774730255.423104}
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX04561') HTTP/1.1" 204 0
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_8ece123f77e33736696a5831bfc5eeb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_8ece123f77e33736696a5831bfc5eeb1.jpg not downloaded yet
2026-03-28 20:37:35 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-28 20:37:35 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [auto1.be] INFO: Scrape type for BC33060: 1
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_824e7e75833826462b03ea3eca3fac6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_824e7e75833826462b03ea3eca3fac6b.jpg not downloaded yet
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV00163> (referer: https://www.auto1.com/v1/car-details-view/SV00163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a5aa50>
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_930314ca0b929890fd1ef2222a86baa5.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_930314ca0b929890fd1ef2222a86baa5.jpg saved to cache
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f8e6b545850e18d145727b2fc8f66365.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_141f60cef8a1ad5ba1b90a23e0fb6faa.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_45421a97f569ad98e3995ad4817a9b14.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_45421a97f569ad98e3995ad4817a9b14.jpg not downloaded yet
2026-03-28 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF44164> (referer: https://www.auto1.com/v1/car-details-view/LF44164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK43455/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT48733> (referer: https://www.auto1.com/v1/car-details-view/BT48733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_9f93308d0014943eb709c97a3422814c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:35 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-28 20:37:35 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [auto1.be] INFO: Scrape type for EP00364: 1
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_c3025cb483bb24cc02cdd39ddebe00d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_c3025cb483bb24cc02cdd39ddebe00d9.jpg not downloaded yet
2026-03-28 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM81672> (referer: https://www.auto1.com/v1/car-details-view/KM81672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_40e4c9ffa866ab07bda4dd826bd2e093.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_40e4c9ffa866ab07bda4dd826bd2e093.jpg not downloaded yet
2026-03-28 20:37:35 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-28 20:37:35 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-28 20:37:35 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [auto1.be] INFO: Scrape type for HB59214: 1
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_2efb68f6417523ce79022c59c4223ffd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_2efb68f6417523ce79022c59c4223ffd.jpg not downloaded yet
2026-03-28 20:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163
2026-03-28 20:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c566c069-0a72-54bc-ab15-e9ef17b296a2 with scrape type 1
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c566c069-0a72-54bc-ab15-e9ef17b296a2
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_0c1836735a2e3ba8f414618b99d0c8de.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_0c1836735a2e3ba8f414618b99d0c8de.jpg not downloaded yet
2026-03-28 20:37:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a0fd50>
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_f8e6b545850e18d145727b2fc8f66365.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f8e6b545850e18d145727b2fc8f66365.jpg saved to cache
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f36310>
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_141f60cef8a1ad5ba1b90a23e0fb6faa.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_141f60cef8a1ad5ba1b90a23e0fb6faa.jpg saved to cache
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164
2026-03-28 20:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with scrape type 1
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_febc45ec52c64bd3226ebce419cd5b9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_febc45ec52c64bd3226ebce419cd5b9a.jpg not downloaded yet
2026-03-28 20:37:36 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1094 | hits on page: 40
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [auto1.be] INFO: Scrape type for SX95001: 1
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_652f5b718bd4790780af82f81b760009.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_652f5b718bd4790780af82f81b760009.jpg not downloaded yet
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_3f519b5ff6490b3bb6c2ce488d697b5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_3f519b5ff6490b3bb6c2ce488d697b5c.jpg not downloaded yet
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_8701a1d9aa5fc110e925798f7c5353c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_8701a1d9aa5fc110e925798f7c5353c2.jpg not downloaded yet
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [auto1.be] INFO: Scrape type for KZ05274: 1
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [auto1.be] INFO: Scrape type for UR33188: 1
2026-03-28 20:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_c2c0689685b94cc12ca6f7f19fdf2d55.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_c2c0689685b94cc12ca6f7f19fdf2d55.jpg not downloaded yet
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_26e21e6138014184a3a3691cb359cb02.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_26e21e6138014184a3a3691cb359cb02.jpg not downloaded yet
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [auto1.be] INFO: Scrape type for HK87235: 1
2026-03-28 20:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733
2026-03-28 20:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24205427-2b64-5c45-941a-a84c4ee8095c with scrape type 1
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_4dd017654820b46f3a54730bb6910a08.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4dd017654820b46f3a54730bb6910a08.jpg not downloaded yet
2026-03-28 20:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f34fd0>
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_9f93308d0014943eb709c97a3422814c.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_9f93308d0014943eb709c97a3422814c.jpg saved to cache
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672
2026-03-28 20:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a with scrape type 1
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_eba3a353f60d919737bdff8065be7965.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_eba3a353f60d919737bdff8065be7965.jpg not downloaded yet
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [auto1.be] INFO: Scrape type for FJ57746: 1
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_f8c06dd33c9d090fe1959f99f2e67eee.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_f8c06dd33c9d090fe1959f99f2e67eee.jpg not downloaded yet
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_5b7f309f3f784ff5ac417ad72e4c6f66.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5b7f309f3f784ff5ac417ad72e4c6f66.jpg not downloaded yet
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-28 20:37:36 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [auto1.be] INFO: Scrape type for CD22470: 2
2026-03-28 20:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470
2026-03-28 20:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580a2be0-03e5-501a-abfb-e50d3f47824e with scrape type 2
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 580a2be0-03e5-501a-abfb-e50d3f47824e with scrape type 2
2026-03-28 20:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 580a2be0-03e5-501a-abfb-e50d3f47824e, identifier: CD22470
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_a7a72613cfff9442a4d4273707f4c3b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_a7a72613cfff9442a4d4273707f4c3b4.jpg not downloaded yet
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_2ced30faf86ddcfee7cb49191a86188f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_2ced30faf86ddcfee7cb49191a86188f.jpg not downloaded yet
2026-03-28 20:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 20:37:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470
2026-03-28 20:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 580a2be0-03e5-501a-abfb-e50d3f47824e with identifier: CD22470 to the API
2026-03-28 20:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:10:19Z',
 'fuel_type': 'petrol',
 'id': '580a2be0-03e5-501a-abfb-e50d3f47824e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD22470',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 142922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [auto1.be] INFO: Saving data for CD22470: {'auction_closing_time': 1774883419.0, 'created_time': 1773384588.893456, 'last_price_update_time': 1774730257.187175}
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD22470') HTTP/1.1" 204 0
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_4ae0ccf8fa6aae3b74e7b0ec97257dc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_4ae0ccf8fa6aae3b74e7b0ec97257dc3.jpg not downloaded yet
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_6ca19c587bdb9c51a787c38de8cad0bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_6ca19c587bdb9c51a787c38de8cad0bc.jpg not downloaded yet
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [auto1.be] INFO: Scrape type for SJ05954: 1
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_0693111c07037efc1d61004da7218dbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_0693111c07037efc1d61004da7218dbd.jpg not downloaded yet
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_5d693c0534303288452b1b44b9fee407.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_5d693c0534303288452b1b44b9fee407.jpg not downloaded yet
2026-03-28 20:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_0c1836735a2e3ba8f414618b99d0c8de.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_c3025cb483bb24cc02cdd39ddebe00d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_2efb68f6417523ce79022c59c4223ffd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_febc45ec52c64bd3226ebce419cd5b9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_40e4c9ffa866ab07bda4dd826bd2e093.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_9c6600f25c0fe5bab271ae2f8f0b1f1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_9c6600f25c0fe5bab271ae2f8f0b1f1d.jpg not downloaded yet
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_54c9c07b828b85b204b9173999a0bef6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_54c9c07b828b85b204b9173999a0bef6.jpg not downloaded yet
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [auto1.be] INFO: Scrape type for PG48700: 1
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_4352ea2dedeb0904e67a110f8c52800b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4352ea2dedeb0904e67a110f8c52800b.jpg not downloaded yet
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_595891078387ba4e9452ce9762150b25.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_595891078387ba4e9452ce9762150b25.jpg not downloaded yet
2026-03-28 20:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB51494> (referer: https://www.auto1.com/v1/car-details-view/SB51494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_17fae794f51f090c1d2e2e4a1af471bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_17fae794f51f090c1d2e2e4a1af471bc.jpg not downloaded yet
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [auto1.be] INFO: Scrape type for FV90992: 1
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_341353d91cbaa33af7dfaa46b3cac511.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_341353d91cbaa33af7dfaa46b3cac511.jpg not downloaded yet
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_598a849dd6ba21eaa6f0b7b778cf55e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_598a849dd6ba21eaa6f0b7b778cf55e5.jpg not downloaded yet
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_5826c6bf5664fc27771c1280388197fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5826c6bf5664fc27771c1280388197fe.jpg not downloaded yet
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [auto1.be] INFO: Scrape type for DC62563: 1
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_3ccdb71a5a8d9eed4fe8f18c355b1ada.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_3ccdb71a5a8d9eed4fe8f18c355b1ada.jpg not downloaded yet
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_86feccfe6df108e43a8da19f4a948e97.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_86feccfe6df108e43a8da19f4a948e97.jpg not downloaded yet
2026-03-28 20:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_f8c06dd33c9d090fe1959f99f2e67eee.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80305bfd0>
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_0c1836735a2e3ba8f414618b99d0c8de.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_0c1836735a2e3ba8f414618b99d0c8de.jpg saved to cache
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c566c069-0a72-54bc-ab15-e9ef17b296a2
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c756d0>
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_c3025cb483bb24cc02cdd39ddebe00d9.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_c3025cb483bb24cc02cdd39ddebe00d9.jpg saved to cache
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fb4350>
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_2efb68f6417523ce79022c59c4223ffd.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_2efb68f6417523ce79022c59c4223ffd.jpg saved to cache
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c67150>
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_febc45ec52c64bd3226ebce419cd5b9a.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_febc45ec52c64bd3226ebce419cd5b9a.jpg saved to cache
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fac550>
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_40e4c9ffa866ab07bda4dd826bd2e093.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_40e4c9ffa866ab07bda4dd826bd2e093.jpg saved to cache
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_a59ea44f40cebc83c69e3b4657465769.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_a59ea44f40cebc83c69e3b4657465769.jpg not downloaded yet
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [auto1.be] INFO: Scrape type for ZP95092: 0
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-28 20:37:37 [auto1.be] INFO: Scrape type for ZR35447: 0
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-28 20:37:37 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for CA54828: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for FW70524: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for NZ74768: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for AC55620: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for YZ92764: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for ZZ63767: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for VW23905: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for BZ70123: 0
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-28 20:37:38 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [auto1.be] INFO: Scrape type for XC95069: 0
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_d1bb8c7b153eea612963730096145961.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_d1bb8c7b153eea612963730096145961.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_d834bc7f6902b96f7edb96fddda850b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_d834bc7f6902b96f7edb96fddda850b4.jpg not downloaded yet
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_a7a72613cfff9442a4d4273707f4c3b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5b7f309f3f784ff5ac417ad72e4c6f66.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_595891078387ba4e9452ce9762150b25.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_21db5c1295417403246be830df7fe688.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_21db5c1295417403246be830df7fe688.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_26c744b71a2d83a68289f4a6b22ad615.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_26c744b71a2d83a68289f4a6b22ad615.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_80b6c0f707a7fd1f85a0a4846cb61384.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_80b6c0f707a7fd1f85a0a4846cb61384.jpg not downloaded yet
2026-03-28 20:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494
2026-03-28 20:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with scrape type 1
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_20121750efaeffad0f6ad913749def44.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_20121750efaeffad0f6ad913749def44.jpg not downloaded yet
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fad9d0>
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_f8c06dd33c9d090fe1959f99f2e67eee.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_f8c06dd33c9d090fe1959f99f2e67eee.jpg saved to cache
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c566c069-0a72-54bc-ab15-e9ef17b296a2
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV65314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE63964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM07385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF94293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_bc9eb7f6dfcfb717bbb9b59e06141dfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_bc9eb7f6dfcfb717bbb9b59e06141dfa.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_afc8108a7c3f33171baabf84a272a5a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_afc8108a7c3f33171baabf84a272a5a5.jpg not downloaded yet
2026-03-28 20:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_7b0502b68e5933091456d94333bfb6cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_7b0502b68e5933091456d94333bfb6cd.jpg not downloaded yet
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80313fc90>
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_a7a72613cfff9442a4d4273707f4c3b4.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_a7a72613cfff9442a4d4273707f4c3b4.jpg saved to cache
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a7e510>
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_5b7f309f3f784ff5ac417ad72e4c6f66.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5b7f309f3f784ff5ac417ad72e4c6f66.jpg saved to cache
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031c34d0>
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_595891078387ba4e9452ce9762150b25.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_595891078387ba4e9452ce9762150b25.jpg saved to cache
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_30f6b80e54e06e5d2aa7ec1573b8488f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_30f6b80e54e06e5d2aa7ec1573b8488f.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_12fe81879251a7bb26388cd70ca21880.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_12fe81879251a7bb26388cd70ca21880.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_919c6f394326a16dfe65a747c1f5c08b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_919c6f394326a16dfe65a747c1f5c08b.jpg not downloaded yet
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_d1bb8c7b153eea612963730096145961.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_2ced30faf86ddcfee7cb49191a86188f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_a59ea44f40cebc83c69e3b4657465769.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_1b75caf2b7482ae81e9537173710adef.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1b75caf2b7482ae81e9537173710adef.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_1bdae6941d994effbfc50a6e811c3748.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1bdae6941d994effbfc50a6e811c3748.jpg not downloaded yet
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_598a849dd6ba21eaa6f0b7b778cf55e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_ef964780a8b9515059020ec7aaa063a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef964780a8b9515059020ec7aaa063a3.jpg not downloaded yet
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_20121750efaeffad0f6ad913749def44.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_ef418cd2a90a928282863fc212dae506.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef418cd2a90a928282863fc212dae506.jpg not downloaded yet
2026-03-28 20:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_919c6f394326a16dfe65a747c1f5c08b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_b120cd6307fcbf592fb5716f58953fb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_b120cd6307fcbf592fb5716f58953fb7.jpg not downloaded yet
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_c37bd9d747613be17b5f381d91b33c27.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_c37bd9d747613be17b5f381d91b33c27.jpg not downloaded yet
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031c9650>
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_d1bb8c7b153eea612963730096145961.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_d1bb8c7b153eea612963730096145961.jpg saved to cache
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:37:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:37:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cd3210>
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_2ced30faf86ddcfee7cb49191a86188f.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_2ced30faf86ddcfee7cb49191a86188f.jpg saved to cache
2026-03-28 20:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bcf310>
2026-03-28 20:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_a59ea44f40cebc83c69e3b4657465769.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_a59ea44f40cebc83c69e3b4657465769.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_21db5c1295417403246be830df7fe688.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_fe7889093850ce34d6ab07de967a9a6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_fe7889093850ce34d6ab07de967a9a6a.jpg not downloaded yet
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1bdae6941d994effbfc50a6e811c3748.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef964780a8b9515059020ec7aaa063a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX95001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:37:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:37:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a96f90>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_598a849dd6ba21eaa6f0b7b778cf55e5.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_598a849dd6ba21eaa6f0b7b778cf55e5.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803068050>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_20121750efaeffad0f6ad913749def44.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_20121750efaeffad0f6ad913749def44.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80302e750>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_919c6f394326a16dfe65a747c1f5c08b.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_919c6f394326a16dfe65a747c1f5c08b.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803be6950>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_21db5c1295417403246be830df7fe688.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_21db5c1295417403246be830df7fe688.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef418cd2a90a928282863fc212dae506.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_c37bd9d747613be17b5f381d91b33c27.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_b120cd6307fcbf592fb5716f58953fb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a5bcd0>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_1bdae6941d994effbfc50a6e811c3748.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1bdae6941d994effbfc50a6e811c3748.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803030a50>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_ef964780a8b9515059020ec7aaa063a3.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef964780a8b9515059020ec7aaa063a3.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_80b6c0f707a7fd1f85a0a4846cb61384.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fe98d0>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_ef418cd2a90a928282863fc212dae506.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef418cd2a90a928282863fc212dae506.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f10810>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_c37bd9d747613be17b5f381d91b33c27.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_c37bd9d747613be17b5f381d91b33c27.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b73d90>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_b120cd6307fcbf592fb5716f58953fb7.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_b120cd6307fcbf592fb5716f58953fb7.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_fe7889093850ce34d6ab07de967a9a6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1b75caf2b7482ae81e9537173710adef.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB59214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031205d0>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_80b6c0f707a7fd1f85a0a4846cb61384.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_80b6c0f707a7fd1f85a0a4846cb61384.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_d834bc7f6902b96f7edb96fddda850b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_26c744b71a2d83a68289f4a6b22ad615.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_7b0502b68e5933091456d94333bfb6cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_12fe81879251a7bb26388cd70ca21880.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c8da50>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_fe7889093850ce34d6ab07de967a9a6a.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_fe7889093850ce34d6ab07de967a9a6a.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a09a90>
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_1b75caf2b7482ae81e9537173710adef.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1b75caf2b7482ae81e9537173710adef.jpg saved to cache
2026-03-28 20:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:39 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1094 | hits on page: 40
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for BS70441: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for GM14941: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for SY87797: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: VK18525
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK18525%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for VK18525: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for WV78161: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for ZV95387: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for KB40459: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for ZZ39097: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for SC10935: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for BU18930: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for CN37182: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for EK79460: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for KE51169: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for XS76018: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-28 20:37:39 [auto1.be] INFO: Scrape type for UY92003: 0
2026-03-28 20:37:39 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for NV64774: 0
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for ET88330: 0
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for KT00341: 0
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for YH90615: 0
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for CU35051: 0
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for PK02246: 0
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for LY17098: 0
2026-03-28 20:37:40 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-28 20:37:40 [auto1.be] INFO: Scrape type for FC78029: 0
2026-03-28 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_30f6b80e54e06e5d2aa7ec1573b8488f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_bc9eb7f6dfcfb717bbb9b59e06141dfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_86feccfe6df108e43a8da19f4a948e97.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_afc8108a7c3f33171baabf84a272a5a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ57746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK43455> (referer: https://www.auto1.com/v1/car-details-view/RK43455/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803032190>
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_d834bc7f6902b96f7edb96fddda850b4.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_d834bc7f6902b96f7edb96fddda850b4.jpg saved to cache
2026-03-28 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80302f9d0>
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_26c744b71a2d83a68289f4a6b22ad615.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_26c744b71a2d83a68289f4a6b22ad615.jpg saved to cache
2026-03-28 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bdef50>
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff5%252F1ef54d0e4b0137a4ab118dea04c9fec3%252Fpa%252FSB51494_7b0502b68e5933091456d94333bfb6cd.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_7b0502b68e5933091456d94333bfb6cd.jpg saved to cache
2026-03-28 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5
2026-03-28 20:37:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5, skipping ID generation
2026-03-28 20:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with scrape type 1
2026-03-28 20:37:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 sending to next pipeline
2026-03-28 20:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5, identifier: SB51494
2026-03-28 20:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803056690>
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_12fe81879251a7bb26388cd70ca21880.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_12fe81879251a7bb26388cd70ca21880.jpg saved to cache
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494
2026-03-28 20:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494
2026-03-28 20:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8bdd530-5c7a-5298-ba3b-5eda5876d2b5 with identifier: SB51494 to the API
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_7b0502b68e5933091456d94333bfb6cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:00Z',
 'fuel_type': 'diesel',
 'id': 'a8bdd530-5c7a-5298-ba3b-5eda5876d2b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB51494',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 132831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_20121750efaeffad0f6ad913749def44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076925,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_7b0502b68e5933091456d94333bfb6cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_919c6f394326a16dfe65a747c1f5c08b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1b75caf2b7482ae81e9537173710adef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_1bdae6941d994effbfc50a6e811c3748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef964780a8b9515059020ec7aaa063a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_ef418cd2a90a928282863fc212dae506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_b120cd6307fcbf592fb5716f58953fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_c37bd9d747613be17b5f381d91b33c27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bdd530-5c7a-5298-ba3b-5eda5876d2b5/a8bdd530-5c7a-5298-ba3b-5eda5876d2b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f5/1ef54d0e4b0137a4ab118dea04c9fec3/pa/SB51494_fe7889093850ce34d6ab07de967a9a6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D Highgate',
 'transmission': 'manual',
 'trim': 'Highgate',
 'year': 2013}
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [auto1.be] INFO: Saving data for SB51494: {'created_time': 1774730261.467515, 'last_price_update_time': 1774730261.467526, 'auction_closing_time': 1774886160.0}
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB51494') HTTP/1.1" 204 0
2026-03-28 20:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE63964> (referer: https://www.auto1.com/v1/car-details-view/AE63964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX95001> (referer: https://www.auto1.com/v1/car-details-view/SX95001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM07385> (referer: https://www.auto1.com/v1/car-details-view/VM07385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF94293> (referer: https://www.auto1.com/v1/car-details-view/KF94293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a16b10>
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_30f6b80e54e06e5d2aa7ec1573b8488f.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_30f6b80e54e06e5d2aa7ec1573b8488f.jpg saved to cache
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c76850>
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_bc9eb7f6dfcfb717bbb9b59e06141dfa.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_bc9eb7f6dfcfb717bbb9b59e06141dfa.jpg saved to cache
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8109f8550>
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_86feccfe6df108e43a8da19f4a948e97.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_86feccfe6df108e43a8da19f4a948e97.jpg saved to cache
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80302b4d0>
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_afc8108a7c3f33171baabf84a272a5a5.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_afc8108a7c3f33171baabf84a272a5a5.jpg saved to cache
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455
2026-03-28 20:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423a3563-48c9-520f-b109-1929aa182f5f with scrape type 1
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 423a3563-48c9-520f-b109-1929aa182f5f
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_43e4140d130d10f857ca833965111ba2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_43e4140d130d10f857ca833965111ba2.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_5b40000ced6349b5b3f716e0f401e99d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_5b40000ced6349b5b3f716e0f401e99d.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_411786df6d636d3a18498524c9d3ba3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_411786df6d636d3a18498524c9d3ba3f.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_19ae504f1f0495cef26fb37f2e533730.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_19ae504f1f0495cef26fb37f2e533730.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_52beb254c9ad77b018c132fa961fcc17.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_52beb254c9ad77b018c132fa961fcc17.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_5411b8acf7c3194d3a307507a57cdb15.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_5411b8acf7c3194d3a307507a57cdb15.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_09a2ceee3bf35ff454b21b70d9b3f19b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_09a2ceee3bf35ff454b21b70d9b3f19b.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_9184a59d99afa8a8da7a74422d3c70d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_9184a59d99afa8a8da7a74422d3c70d4.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_f295d29e55520127ab81b36fb37b7ef3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_f295d29e55520127ab81b36fb37b7ef3.jpg already downloaded
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F96%252F5d96889b96836b016e3bb9519a084873%252Fpa%252FRK43455_c259a25426bf6cc4c0a337364ebb18fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_c259a25426bf6cc4c0a337364ebb18fd.jpg already downloaded
2026-03-28 20:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 423a3563-48c9-520f-b109-1929aa182f5f, identifier: RK43455
2026-03-28 20:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455
2026-03-28 20:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455
2026-03-28 20:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 423a3563-48c9-520f-b109-1929aa182f5f with identifier: RK43455 to the API
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK43455>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:44Z',
 'fuel_type': 'diesel',
 'id': '423a3563-48c9-520f-b109-1929aa182f5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK43455',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '5er',
 'odometer': 124696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_43e4140d130d10f857ca833965111ba2.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_5b40000ced6349b5b3f716e0f401e99d.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_411786df6d636d3a18498524c9d3ba3f.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_19ae504f1f0495cef26fb37f2e533730.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_52beb254c9ad77b018c132fa961fcc17.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_5411b8acf7c3194d3a307507a57cdb15.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_09a2ceee3bf35ff454b21b70d9b3f19b.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_9184a59d99afa8a8da7a74422d3c70d4.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_f295d29e55520127ab81b36fb37b7ef3.jpg',
                'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_c259a25426bf6cc4c0a337364ebb18fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_43e4140d130d10f857ca833965111ba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_5b40000ced6349b5b3f716e0f401e99d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_411786df6d636d3a18498524c9d3ba3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_19ae504f1f0495cef26fb37f2e533730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_52beb254c9ad77b018c132fa961fcc17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_5411b8acf7c3194d3a307507a57cdb15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_09a2ceee3bf35ff454b21b70d9b3f19b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_9184a59d99afa8a8da7a74422d3c70d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_f295d29e55520127ab81b36fb37b7ef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_423a3563-48c9-520f-b109-1929aa182f5f/423a3563-48c9-520f-b109-1929aa182f5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/96/5d96889b96836b016e3bb9519a084873/pa/RK43455_c259a25426bf6cc4c0a337364ebb18fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [auto1.be] INFO: Saving data for RK43455: {'created_time': 1774730262.404694, 'last_price_update_time': 1774730262.404711, 'auction_closing_time': 1774884044.0}
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK43455') HTTP/1.1" 204 0
2026-03-28 20:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4352ea2dedeb0904e67a110f8c52800b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964
2026-03-28 20:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with scrape type 1
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_47b34420b00dc730819f34521643c0cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_47b34420b00dc730819f34521643c0cc.jpg not downloaded yet
2026-03-28 20:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001
2026-03-28 20:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with scrape type 1
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_52a195ca77059b5413c95ab6953ff5d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_52a195ca77059b5413c95ab6953ff5d7.jpg not downloaded yet
2026-03-28 20:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385
2026-03-28 20:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with scrape type 1
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c158ab2c-d2b1-52b4-8ce7-d3694263ba9c
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F28%252F4628be0f054252784409d6da0d0c60b9%252Fpa%252FVM07385_ae8b10f4a56b0696b3b45903972b65c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_ae8b10f4a56b0696b3b45903972b65c5.jpg already downloaded
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F28%252F4628be0f054252784409d6da0d0c60b9%252Fpa%252FVM07385_2a5a2c37a30d3f0f4164c174ef3de3cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_2a5a2c37a30d3f0f4164c174ef3de3cd.jpg already downloaded
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F28%252F4628be0f054252784409d6da0d0c60b9%252Fpa%252FVM07385_a2d63c54c6d15dae880a41904f673a56.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_a2d63c54c6d15dae880a41904f673a56.jpg already downloaded
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F28%252F4628be0f054252784409d6da0d0c60b9%252Fpa%252FVM07385_c339b9a487a77b820df6cf13a78f38cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_c339b9a487a77b820df6cf13a78f38cb.jpg already downloaded
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F28%252F4628be0f054252784409d6da0d0c60b9%252Fpa%252FVM07385_ea7c6aeeb66907de7693556439eb1dae.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_ea7c6aeeb66907de7693556439eb1dae.jpg already downloaded
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F28%252F4628be0f054252784409d6da0d0c60b9%252Fpa%252FVM07385_b034571b640ce4c93ed0370acff008d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_b034571b640ce4c93ed0370acff008d6.jpg already downloaded
2026-03-28 20:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c, identifier: VM07385
2026-03-28 20:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293
2026-03-28 20:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830f3b14-21de-50cb-af11-f25c3a379396 with scrape type 1
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_a095afb57d94bdbbd4965b81e057380e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a095afb57d94bdbbd4965b81e057380e.jpg not downloaded yet
2026-03-28 20:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385
2026-03-28 20:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385
2026-03-28 20:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c158ab2c-d2b1-52b4-8ce7-d3694263ba9c with identifier: VM07385 to the API
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM07385>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:48Z',
 'fuel_type': 'diesel',
 'id': 'c158ab2c-d2b1-52b4-8ce7-d3694263ba9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM07385',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 219636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_ae8b10f4a56b0696b3b45903972b65c5.jpg',
                'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_2a5a2c37a30d3f0f4164c174ef3de3cd.jpg',
                'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_a2d63c54c6d15dae880a41904f673a56.jpg',
                'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_c339b9a487a77b820df6cf13a78f38cb.jpg',
                'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_ea7c6aeeb66907de7693556439eb1dae.jpg',
                'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_b034571b640ce4c93ed0370acff008d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c158ab2c-d2b1-52b4-8ce7-d3694263ba9c/c158ab2c-d2b1-52b4-8ce7-d3694263ba9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_ae8b10f4a56b0696b3b45903972b65c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c158ab2c-d2b1-52b4-8ce7-d3694263ba9c/c158ab2c-d2b1-52b4-8ce7-d3694263ba9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_2a5a2c37a30d3f0f4164c174ef3de3cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c158ab2c-d2b1-52b4-8ce7-d3694263ba9c/c158ab2c-d2b1-52b4-8ce7-d3694263ba9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_a2d63c54c6d15dae880a41904f673a56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c158ab2c-d2b1-52b4-8ce7-d3694263ba9c/c158ab2c-d2b1-52b4-8ce7-d3694263ba9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_c339b9a487a77b820df6cf13a78f38cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c158ab2c-d2b1-52b4-8ce7-d3694263ba9c/c158ab2c-d2b1-52b4-8ce7-d3694263ba9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_ea7c6aeeb66907de7693556439eb1dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c158ab2c-d2b1-52b4-8ce7-d3694263ba9c/c158ab2c-d2b1-52b4-8ce7-d3694263ba9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/28/4628be0f054252784409d6da0d0c60b9/pa/VM07385_b034571b640ce4c93ed0370acff008d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LT',
 'transmission': 'automatic',
 'trim': 'LT',
 'year': 2011}
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [auto1.be] INFO: Saving data for VM07385: {'created_time': 1774730263.048777, 'last_price_update_time': 1774730263.048791, 'auction_closing_time': 1774885728.0}
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM07385') HTTP/1.1" 204 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_63b51c06d9465de5021ebc30936cdb22.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_63b51c06d9465de5021ebc30936cdb22.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_c62e0d18457e3892af12d79c8bdc868b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_c62e0d18457e3892af12d79c8bdc868b.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_f924b28ffe11725af229fe5e6613b65f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_f924b28ffe11725af229fe5e6613b65f.jpg not downloaded yet
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_9c6600f25c0fe5bab271ae2f8f0b1f1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_54c9c07b828b85b204b9173999a0bef6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_5d693c0534303288452b1b44b9fee407.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_1e0b46fb213484761e16b20a0d063be2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_1e0b46fb213484761e16b20a0d063be2.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_4969d291c5793611e169a43057c87d52.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_4969d291c5793611e169a43057c87d52.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_b212e29e29624f8e51faf3d9cc1b03c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_b212e29e29624f8e51faf3d9cc1b03c5.jpg not downloaded yet
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b1b610>
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_4352ea2dedeb0904e67a110f8c52800b.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4352ea2dedeb0904e67a110f8c52800b.jpg saved to cache
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_801b4e879f8b3b4885f9f2389e5fb366.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_801b4e879f8b3b4885f9f2389e5fb366.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_84fe29bde7b3ef272eef6f4bf3d7b666.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_84fe29bde7b3ef272eef6f4bf3d7b666.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_278b1d093a27487506b8f74dc9906f9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_278b1d093a27487506b8f74dc9906f9e.jpg not downloaded yet
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80308a390>
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_9c6600f25c0fe5bab271ae2f8f0b1f1d.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_9c6600f25c0fe5bab271ae2f8f0b1f1d.jpg saved to cache
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c566c069-0a72-54bc-ab15-e9ef17b296a2
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803064b10>
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_54c9c07b828b85b204b9173999a0bef6.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_54c9c07b828b85b204b9173999a0bef6.jpg saved to cache
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cc8610>
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_5d693c0534303288452b1b44b9fee407.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_5d693c0534303288452b1b44b9fee407.jpg saved to cache
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_295fa7cdab9de43d5b313b3cc9cb3e19.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_295fa7cdab9de43d5b313b3cc9cb3e19.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_033cdea31d1dc1647a8b59a9a142d0fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_033cdea31d1dc1647a8b59a9a142d0fc.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_a3661f444f85511a5cb4e52258df5209.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a3661f444f85511a5cb4e52258df5209.jpg not downloaded yet
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_c62e0d18457e3892af12d79c8bdc868b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_f924b28ffe11725af229fe5e6613b65f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV65314> (referer: https://www.auto1.com/v1/car-details-view/WV65314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_63b51c06d9465de5021ebc30936cdb22.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_2241dbcefa2d9e4fb1ea5cc0ed18b448.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_2241dbcefa2d9e4fb1ea5cc0ed18b448.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_e1c3277337cccf2e1306e637c7d5cf9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_e1c3277337cccf2e1306e637c7d5cf9f.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_cf70f2879b5c876629d85a473b9403c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_cf70f2879b5c876629d85a473b9403c8.jpg not downloaded yet
2026-03-28 20:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_ede7b2370958d4b40f198fbcdd444a85.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_ede7b2370958d4b40f198fbcdd444a85.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_96d228a5593494507a5adc902f3b1c7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_96d228a5593494507a5adc902f3b1c7a.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_503b1b8cc3ce728697b7dfff3516623b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_503b1b8cc3ce728697b7dfff3516623b.jpg not downloaded yet
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1cd10>
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_c62e0d18457e3892af12d79c8bdc868b.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_c62e0d18457e3892af12d79c8bdc868b.jpg saved to cache
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030bc590>
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_f924b28ffe11725af229fe5e6613b65f.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_f924b28ffe11725af229fe5e6613b65f.jpg saved to cache
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314
2026-03-28 20:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2177c307-6709-58df-b329-39d688b55b6a with scrape type 1
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_0cfc851aad67f8fcb9db18d20b3a3657.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_0cfc851aad67f8fcb9db18d20b3a3657.jpg not downloaded yet
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bb7d50>
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_63b51c06d9465de5021ebc30936cdb22.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_63b51c06d9465de5021ebc30936cdb22.jpg saved to cache
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_b626d65e62ba3e9b36b2e3a3a0888ccf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_b626d65e62ba3e9b36b2e3a3a0888ccf.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_63935c8bd48d1739700eb70136fbe972.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_63935c8bd48d1739700eb70136fbe972.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_413d70adb18c793cf0a4ed292c67d2d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_413d70adb18c793cf0a4ed292c67d2d9.jpg not downloaded yet
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_033cdea31d1dc1647a8b59a9a142d0fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_278b1d093a27487506b8f74dc9906f9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a3661f444f85511a5cb4e52258df5209.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_4cbeb1011a20557e491727d2efdc831b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_4cbeb1011a20557e491727d2efdc831b.jpg not downloaded yet
2026-03-28 20:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_295fa7cdab9de43d5b313b3cc9cb3e19.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_e44ed90a6f9f87c1e563488e54a0f9d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_e44ed90a6f9f87c1e563488e54a0f9d7.jpg not downloaded yet
2026-03-28 20:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_0ce7c56a53002244b8bb799cee9f2263.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_0ce7c56a53002244b8bb799cee9f2263.jpg not downloaded yet
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_ca27f824309c06765e87336cd5f37ee6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_ca27f824309c06765e87336cd5f37ee6.jpg not downloaded yet
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_eace2735c07c6e59104a8bf7368d6eba.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_eace2735c07c6e59104a8bf7368d6eba.jpg not downloaded yet
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV90992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB59214> (referer: https://www.auto1.com/v1/car-details-view/HB59214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_a9706651079aae5b683aa95520d7020b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_a9706651079aae5b683aa95520d7020b.jpg not downloaded yet
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_6bda91a630fddb4f5d228f25ff8f7491.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_6bda91a630fddb4f5d228f25ff8f7491.jpg not downloaded yet
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_735a83c0f1b71290fbf628e0b78b917f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_735a83c0f1b71290fbf628e0b78b917f.jpg not downloaded yet
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG48700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_71e9ea161f402fa0240cd4ac3d6248fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_71e9ea161f402fa0240cd4ac3d6248fb.jpg not downloaded yet
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_96d228a5593494507a5adc902f3b1c7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_503b1b8cc3ce728697b7dfff3516623b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_0cfc851aad67f8fcb9db18d20b3a3657.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_413d70adb18c793cf0a4ed292c67d2d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_73214e3cf198bf27a415c84447c60dc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_73214e3cf198bf27a415c84447c60dc5.jpg not downloaded yet
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC62563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b0c690>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_033cdea31d1dc1647a8b59a9a142d0fc.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_033cdea31d1dc1647a8b59a9a142d0fc.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fe2390>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_278b1d093a27487506b8f74dc9906f9e.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_278b1d093a27487506b8f74dc9906f9e.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fe0a90>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_a3661f444f85511a5cb4e52258df5209.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a3661f444f85511a5cb4e52258df5209.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f88610>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_295fa7cdab9de43d5b313b3cc9cb3e19.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_295fa7cdab9de43d5b313b3cc9cb3e19.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_758c0236db35f18f8abd37e2369bc6d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_758c0236db35f18f8abd37e2369bc6d6.jpg not downloaded yet
2026-03-28 20:37:44 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1094 | hits on page: 40
2026-03-28 20:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214
2026-03-28 20:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a1ba15-27d6-5cc9-b123-c41233090302 with scrape type 1
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d2a1ba15-27d6-5cc9-b123-c41233090302
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_0c7d31d418002b90a5add36babf973c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_0c7d31d418002b90a5add36babf973c0.jpg not downloaded yet
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ccb450>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_96d228a5593494507a5adc902f3b1c7a.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_96d228a5593494507a5adc902f3b1c7a.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bff2d0>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_503b1b8cc3ce728697b7dfff3516623b.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_503b1b8cc3ce728697b7dfff3516623b.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031b00d0>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_0cfc851aad67f8fcb9db18d20b3a3657.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_0cfc851aad67f8fcb9db18d20b3a3657.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803096190>
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_413d70adb18c793cf0a4ed292c67d2d9.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_413d70adb18c793cf0a4ed292c67d2d9.jpg saved to cache
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_eace2735c07c6e59104a8bf7368d6eba.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_a0f161e6b95e9a68da6c2745f3af90d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a0f161e6b95e9a68da6c2745f3af90d8.jpg not downloaded yet
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_17fae794f51f090c1d2e2e4a1af471bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_0ce7c56a53002244b8bb799cee9f2263.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_ca27f824309c06765e87336cd5f37ee6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for EH00335: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for WH49963: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for KL53758: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for RA73981: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for EJ96142: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for HE39793: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for DD83263: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for SW21472: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for EY57880: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for ZN56944: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for HX50025: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for DH53723: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for RD62823: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: MB27937
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB27937%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for MB27937: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for ZG72967: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for UH00217: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for EU75132: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for JY01361: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for FK09845: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-28 20:37:44 [auto1.be] INFO: Scrape type for EB31921: 0
2026-03-28 20:37:44 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-28 20:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [auto1.be] INFO: Scrape type for DJ63605: 0
2026-03-28 20:37:45 [auto1.be] INFO: Found listing with ID: US61346
2026-03-28 20:37:45 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-28 20:37:45 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-28 20:37:45 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_701cf1a42d105322c297939d5bcf55c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_701cf1a42d105322c297939d5bcf55c5.jpg not downloaded yet
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_e44ed90a6f9f87c1e563488e54a0f9d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_d96c60f04cc84de95b5ebae51466f0b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_d96c60f04cc84de95b5ebae51466f0b0.jpg not downloaded yet
2026-03-28 20:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_71e9ea161f402fa0240cd4ac3d6248fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_e9dc219f61bb54fe0a1a8b910fd3906e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_e9dc219f61bb54fe0a1a8b910fd3906e.jpg not downloaded yet
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_b0c8bc8625575e63f4b45c74313da6b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_b0c8bc8625575e63f4b45c74313da6b2.jpg not downloaded yet
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bf7150>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_eace2735c07c6e59104a8bf7368d6eba.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_eace2735c07c6e59104a8bf7368d6eba.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fb5050>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_17fae794f51f090c1d2e2e4a1af471bc.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_17fae794f51f090c1d2e2e4a1af471bc.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306c550>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_0ce7c56a53002244b8bb799cee9f2263.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_0ce7c56a53002244b8bb799cee9f2263.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f43990>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_ca27f824309c06765e87336cd5f37ee6.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_ca27f824309c06765e87336cd5f37ee6.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_92fc6a85a0900c74966d3c258befa892.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_92fc6a85a0900c74966d3c258befa892.jpg not downloaded yet
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_758c0236db35f18f8abd37e2369bc6d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_a1ba2d0e99a0ec228e86f633a34a9db9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a1ba2d0e99a0ec228e86f633a34a9db9.jpg not downloaded yet
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_6bda91a630fddb4f5d228f25ff8f7491.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_4cbeb1011a20557e491727d2efdc831b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_a9706651079aae5b683aa95520d7020b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_8257ef6d46c93dc2c51a5a7d97315e32.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_8257ef6d46c93dc2c51a5a7d97315e32.jpg not downloaded yet
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ57746> (referer: https://www.auto1.com/v1/car-details-view/FJ57746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5826c6bf5664fc27771c1280388197fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_947f20572aea934bfa1f479fdc205600.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_947f20572aea934bfa1f479fdc205600.jpg not downloaded yet
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c5ff10>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_e44ed90a6f9f87c1e563488e54a0f9d7.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_e44ed90a6f9f87c1e563488e54a0f9d7.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f43190>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_71e9ea161f402fa0240cd4ac3d6248fb.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_71e9ea161f402fa0240cd4ac3d6248fb.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_3ccdb71a5a8d9eed4fe8f18c355b1ada.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_341353d91cbaa33af7dfaa46b3cac511.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a0f161e6b95e9a68da6c2745f3af90d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_b0c8bc8625575e63f4b45c74313da6b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_0c7d31d418002b90a5add36babf973c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_701cf1a42d105322c297939d5bcf55c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c66690>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_758c0236db35f18f8abd37e2369bc6d6.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_758c0236db35f18f8abd37e2369bc6d6.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803054d50>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_6bda91a630fddb4f5d228f25ff8f7491.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_6bda91a630fddb4f5d228f25ff8f7491.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031c9690>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_4cbeb1011a20557e491727d2efdc831b.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_4cbeb1011a20557e491727d2efdc831b.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80301f8d0>
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_a9706651079aae5b683aa95520d7020b.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_a9706651079aae5b683aa95520d7020b.jpg saved to cache
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746
2026-03-28 20:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3858d21-6175-57b5-b57b-8639f73467a6 with scrape type 1
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3858d21-6175-57b5-b57b-8639f73467a6
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_7cefe418fd07c77092fcbb46f1e70da5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_7cefe418fd07c77092fcbb46f1e70da5.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_b4e2f03bacb22ef33d145134454b2207.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_b4e2f03bacb22ef33d145134454b2207.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_ecc0a4cc9a73dde35991daf34ae31158.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_ecc0a4cc9a73dde35991daf34ae31158.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_e456fb58e494725a9ad1de3988bd3d16.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_e456fb58e494725a9ad1de3988bd3d16.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_2ff7002f271383cedae1bf01edb8efd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_2ff7002f271383cedae1bf01edb8efd8.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_8af1e3ca6dbca3c66f57841a8a8647fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_8af1e3ca6dbca3c66f57841a8a8647fc.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_d98f4045c3c6e5afc1847692771883d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_d98f4045c3c6e5afc1847692771883d1.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_5676094d35b958ea49d4b6eac8fc9fb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_5676094d35b958ea49d4b6eac8fc9fb3.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_dc255349052274ecba5e927929cb37fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_dc255349052274ecba5e927929cb37fd.jpg already downloaded
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7d%252Fe47d10b74a9a08b896db230cfd438db7%252Fpa%252FFJ57746_66b42d7ec3c3d7019c1b01d9dd79e9d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_66b42d7ec3c3d7019c1b01d9dd79e9d6.jpg already downloaded
2026-03-28 20:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3858d21-6175-57b5-b57b-8639f73467a6, identifier: FJ57746
2026-03-28 20:37:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cef790>
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_5826c6bf5664fc27771c1280388197fe.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5826c6bf5664fc27771c1280388197fe.jpg saved to cache
2026-03-28 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746
2026-03-28 20:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746
2026-03-28 20:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3858d21-6175-57b5-b57b-8639f73467a6 with identifier: FJ57746 to the API
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ57746>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:53:11Z',
 'fuel_type': 'petrol',
 'id': 'f3858d21-6175-57b5-b57b-8639f73467a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ57746',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 54058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_7cefe418fd07c77092fcbb46f1e70da5.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_b4e2f03bacb22ef33d145134454b2207.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_ecc0a4cc9a73dde35991daf34ae31158.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_e456fb58e494725a9ad1de3988bd3d16.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_2ff7002f271383cedae1bf01edb8efd8.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_8af1e3ca6dbca3c66f57841a8a8647fc.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_d98f4045c3c6e5afc1847692771883d1.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_5676094d35b958ea49d4b6eac8fc9fb3.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_dc255349052274ecba5e927929cb37fd.jpg',
                'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_66b42d7ec3c3d7019c1b01d9dd79e9d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2488554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_7cefe418fd07c77092fcbb46f1e70da5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_b4e2f03bacb22ef33d145134454b2207.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_ecc0a4cc9a73dde35991daf34ae31158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_e456fb58e494725a9ad1de3988bd3d16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2170413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_2ff7002f271383cedae1bf01edb8efd8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_8af1e3ca6dbca3c66f57841a8a8647fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2422649,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_d98f4045c3c6e5afc1847692771883d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_5676094d35b958ea49d4b6eac8fc9fb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_dc255349052274ecba5e927929cb37fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3858d21-6175-57b5-b57b-8639f73467a6/f3858d21-6175-57b5-b57b-8639f73467a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340540,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/7d/e47d10b74a9a08b896db230cfd438db7/pa/FJ57746_66b42d7ec3c3d7019c1b01d9dd79e9d6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-28 20:37:46 [auto1.be] INFO: Saving data for FJ57746: {'created_time': 1774730266.736152, 'last_price_update_time': 1774730266.736167, 'auction_closing_time': 1774885991.0}
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ57746') HTTP/1.1" 204 0
2026-03-28 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a1ba2d0e99a0ec228e86f633a34a9db9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_92fc6a85a0900c74966d3c258befa892.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_e9dc219f61bb54fe0a1a8b910fd3906e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_8257ef6d46c93dc2c51a5a7d97315e32.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_d96c60f04cc84de95b5ebae51466f0b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG48700> (referer: https://www.auto1.com/v1/car-details-view/PG48700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC62563> (referer: https://www.auto1.com/v1/car-details-view/DC62563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fd1a10>
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_3ccdb71a5a8d9eed4fe8f18c355b1ada.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_3ccdb71a5a8d9eed4fe8f18c355b1ada.jpg saved to cache
2026-03-28 20:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a41f10>
2026-03-28 20:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_341353d91cbaa33af7dfaa46b3cac511.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_341353d91cbaa33af7dfaa46b3cac511.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811deec90>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_a0f161e6b95e9a68da6c2745f3af90d8.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a0f161e6b95e9a68da6c2745f3af90d8.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a4d110>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_b0c8bc8625575e63f4b45c74313da6b2.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_b0c8bc8625575e63f4b45c74313da6b2.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803be6b10>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_0c7d31d418002b90a5add36babf973c0.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_0c7d31d418002b90a5add36babf973c0.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2a1ba15-27d6-5cc9-b123-c41233090302
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031b1f90>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_701cf1a42d105322c297939d5bcf55c5.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_701cf1a42d105322c297939d5bcf55c5.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2a1ba15-27d6-5cc9-b123-c41233090302
2026-03-28 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a4ecd0>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_a1ba2d0e99a0ec228e86f633a34a9db9.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a1ba2d0e99a0ec228e86f633a34a9db9.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030b2610>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_92fc6a85a0900c74966d3c258befa892.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_92fc6a85a0900c74966d3c258befa892.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2a1ba15-27d6-5cc9-b123-c41233090302
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df0150>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_e9dc219f61bb54fe0a1a8b910fd3906e.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_e9dc219f61bb54fe0a1a8b910fd3906e.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2a1ba15-27d6-5cc9-b123-c41233090302
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030b0090>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_8257ef6d46c93dc2c51a5a7d97315e32.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_8257ef6d46c93dc2c51a5a7d97315e32.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2a1ba15-27d6-5cc9-b123-c41233090302
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df23d0>
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_d96c60f04cc84de95b5ebae51466f0b0.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_d96c60f04cc84de95b5ebae51466f0b0.jpg saved to cache
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700
2026-03-28 20:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74f26fb-36f0-509f-a87e-00f6931e2718 with scrape type 1
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f74f26fb-36f0-509f-a87e-00f6931e2718
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_09060414bb171b21348a205db0bfcc66.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_09060414bb171b21348a205db0bfcc66.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_98b2b04634ae250b29f5aea9722f6c28.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_98b2b04634ae250b29f5aea9722f6c28.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_844c046c56796c39ae1d66aae9827a1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_844c046c56796c39ae1d66aae9827a1b.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_15f9d8a952e316db676b935bf9c5f203.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_15f9d8a952e316db676b935bf9c5f203.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_6c4fd8fbad456f5ffe9c7b933b427e3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_6c4fd8fbad456f5ffe9c7b933b427e3e.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_b293a3e505b80056cba30ed16f573eee.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_b293a3e505b80056cba30ed16f573eee.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_d90ca089a4789ee009f117a1268c0d97.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_d90ca089a4789ee009f117a1268c0d97.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_289a55d338894afeafa8c594dd71a19a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_289a55d338894afeafa8c594dd71a19a.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_19ab0e6538834949e4600da89d3e2461.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_19ab0e6538834949e4600da89d3e2461.jpg already downloaded
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fdc%252F63dc59b1034dc59885429224860feb9d%252Fpa%252FPG48700_89b5176aba87521dc1a6308c4d6f565c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_89b5176aba87521dc1a6308c4d6f565c.jpg already downloaded
2026-03-28 20:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f74f26fb-36f0-509f-a87e-00f6931e2718, identifier: PG48700
2026-03-28 20:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563
2026-03-28 20:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b97ab06-82dc-5178-a422-0105984d638c with scrape type 1
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2b97ab06-82dc-5178-a422-0105984d638c
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_87e2d2cc078c506cdd993ddf48a4b252.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_87e2d2cc078c506cdd993ddf48a4b252.jpg not downloaded yet
2026-03-28 20:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700
2026-03-28 20:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700
2026-03-28 20:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f74f26fb-36f0-509f-a87e-00f6931e2718 with identifier: PG48700 to the API
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PG48700>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:53:32Z',
 'fuel_type': 'petrol',
 'id': 'f74f26fb-36f0-509f-a87e-00f6931e2718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG48700',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_09060414bb171b21348a205db0bfcc66.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_98b2b04634ae250b29f5aea9722f6c28.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_844c046c56796c39ae1d66aae9827a1b.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_15f9d8a952e316db676b935bf9c5f203.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_6c4fd8fbad456f5ffe9c7b933b427e3e.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_b293a3e505b80056cba30ed16f573eee.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_d90ca089a4789ee009f117a1268c0d97.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_289a55d338894afeafa8c594dd71a19a.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_19ab0e6538834949e4600da89d3e2461.jpg',
                'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_89b5176aba87521dc1a6308c4d6f565c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_09060414bb171b21348a205db0bfcc66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_98b2b04634ae250b29f5aea9722f6c28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2005283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_844c046c56796c39ae1d66aae9827a1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1820051,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_15f9d8a952e316db676b935bf9c5f203.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1939620,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_6c4fd8fbad456f5ffe9c7b933b427e3e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1887208,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_b293a3e505b80056cba30ed16f573eee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1838359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_d90ca089a4789ee009f117a1268c0d97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1915200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_289a55d338894afeafa8c594dd71a19a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_19ab0e6538834949e4600da89d3e2461.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74f26fb-36f0-509f-a87e-00f6931e2718/f74f26fb-36f0-509f-a87e-00f6931e2718_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1858732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/dc/63dc59b1034dc59885429224860feb9d/pa/PG48700_89b5176aba87521dc1a6308c4d6f565c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-28 20:37:48 [auto1.be] INFO: Saving data for PG48700: {'created_time': 1774730268.248148, 'last_price_update_time': 1774730268.248169, 'auction_closing_time': 1774886012.0}
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PG48700') HTTP/1.1" 204 0
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_7acdd8f99730034396aa741adf1f1c9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_7acdd8f99730034396aa741adf1f1c9f.jpg not downloaded yet
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_73214e3cf198bf27a415c84447c60dc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_947f20572aea934bfa1f479fdc205600.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_63935c8bd48d1739700eb70136fbe972.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_cf70f2879b5c876629d85a473b9403c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_8ba3bef787da310608dcfd2ef94970b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_8ba3bef787da310608dcfd2ef94970b8.jpg not downloaded yet
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_a61ff517ac3a8169e4d8422dbbb6d457.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_a61ff517ac3a8169e4d8422dbbb6d457.jpg not downloaded yet
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_e1c3277337cccf2e1306e637c7d5cf9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_17abdb58a041e56203bf5864a4a4e233.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_17abdb58a041e56203bf5864a4a4e233.jpg not downloaded yet
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_84fe29bde7b3ef272eef6f4bf3d7b666.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_aed3b0ad3fc49c3aa2fda8a0ea684a18.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_aed3b0ad3fc49c3aa2fda8a0ea684a18.jpg not downloaded yet
2026-03-28 20:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ccced0>
2026-03-28 20:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F7c%252Ff47c48f7fe035a927b26cc57f516a550%252Fpa%252FWV65314_73214e3cf198bf27a415c84447c60dc5.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_73214e3cf198bf27a415c84447c60dc5.jpg saved to cache
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2177c307-6709-58df-b329-39d688b55b6a
2026-03-28 20:37:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2177c307-6709-58df-b329-39d688b55b6a, skipping ID generation
2026-03-28 20:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2177c307-6709-58df-b329-39d688b55b6a with scrape type 1
2026-03-28 20:37:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2177c307-6709-58df-b329-39d688b55b6a sending to next pipeline
2026-03-28 20:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2177c307-6709-58df-b329-39d688b55b6a, identifier: WV65314
2026-03-28 20:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314
2026-03-28 20:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314
2026-03-28 20:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2177c307-6709-58df-b329-39d688b55b6a with identifier: WV65314 to the API
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_73214e3cf198bf27a415c84447c60dc5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:08:42Z',
 'fuel_type': 'diesel',
 'id': '2177c307-6709-58df-b329-39d688b55b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV65314',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 105607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_0cfc851aad67f8fcb9db18d20b3a3657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_4cbeb1011a20557e491727d2efdc831b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_eace2735c07c6e59104a8bf7368d6eba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_71e9ea161f402fa0240cd4ac3d6248fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_73214e3cf198bf27a415c84447c60dc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_758c0236db35f18f8abd37e2369bc6d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a0f161e6b95e9a68da6c2745f3af90d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_d96c60f04cc84de95b5ebae51466f0b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_b0c8bc8625575e63f4b45c74313da6b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2177c307-6709-58df-b329-39d688b55b6a/2177c307-6709-58df-b329-39d688b55b6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/7c/f47c48f7fe035a927b26cc57f516a550/pa/WV65314_a1ba2d0e99a0ec228e86f633a34a9db9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S60 2.4 D5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2011}
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-28 20:37:48 [auto1.be] INFO: Saving data for WV65314: {'created_time': 1774730268.961938, 'last_price_update_time': 1774730268.961952, 'auction_closing_time': 1774883322.0}
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV65314') HTTP/1.1" 204 0
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_b212e29e29624f8e51faf3d9cc1b03c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_801b4e879f8b3b4885f9f2389e5fb366.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a14690>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf148165a99e0b45d17c1c7f0b185%252Fpa%252FHB59214_947f20572aea934bfa1f479fdc205600.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_947f20572aea934bfa1f479fdc205600.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2a1ba15-27d6-5cc9-b123-c41233090302
2026-03-28 20:37:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2a1ba15-27d6-5cc9-b123-c41233090302, skipping ID generation
2026-03-28 20:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a1ba15-27d6-5cc9-b123-c41233090302 with scrape type 1
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2a1ba15-27d6-5cc9-b123-c41233090302 sending to next pipeline
2026-03-28 20:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2a1ba15-27d6-5cc9-b123-c41233090302, identifier: HB59214
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_87e2d2cc078c506cdd993ddf48a4b252.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_4969d291c5793611e169a43057c87d52.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_2241dbcefa2d9e4fb1ea5cc0ed18b448.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214
2026-03-28 20:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214
2026-03-28 20:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2a1ba15-27d6-5cc9-b123-c41233090302 with identifier: HB59214 to the API
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_947f20572aea934bfa1f479fdc205600.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:36:51Z',
 'fuel_type': 'petrol',
 'id': 'd2a1ba15-27d6-5cc9-b123-c41233090302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB59214',
 'listing': 'auction',
 'location': 'BE, Oostende',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 197980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_0c7d31d418002b90a5add36babf973c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_701cf1a42d105322c297939d5bcf55c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_e9dc219f61bb54fe0a1a8b910fd3906e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_92fc6a85a0900c74966d3c258befa892.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_8257ef6d46c93dc2c51a5a7d97315e32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a1ba15-27d6-5cc9-b123-c41233090302/d2a1ba15-27d6-5cc9-b123-c41233090302_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf148165a99e0b45d17c1c7f0b185/pa/HB59214_947f20572aea934bfa1f479fdc205600.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-28 20:37:49 [auto1.be] INFO: Saving data for HB59214: {'created_time': 1774730269.499608, 'last_price_update_time': 1774730269.499621, 'auction_closing_time': 1774885011.0}
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HB59214') HTTP/1.1" 204 0
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1f3d0>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_63935c8bd48d1739700eb70136fbe972.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_63935c8bd48d1739700eb70136fbe972.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bde990>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_cf70f2879b5c876629d85a473b9403c8.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_cf70f2879b5c876629d85a473b9403c8.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:37:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:37:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030efe10>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_e1c3277337cccf2e1306e637c7d5cf9f.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_e1c3277337cccf2e1306e637c7d5cf9f.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031e8750>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_84fe29bde7b3ef272eef6f4bf3d7b666.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_84fe29bde7b3ef272eef6f4bf3d7b666.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_1e0b46fb213484761e16b20a0d063be2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_7acdd8f99730034396aa741adf1f1c9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f21150>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_b212e29e29624f8e51faf3d9cc1b03c5.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_b212e29e29624f8e51faf3d9cc1b03c5.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce8e90>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_801b4e879f8b3b4885f9f2389e5fb366.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_801b4e879f8b3b4885f9f2389e5fb366.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b613d0>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_87e2d2cc078c506cdd993ddf48a4b252.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_87e2d2cc078c506cdd993ddf48a4b252.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b97ab06-82dc-5178-a422-0105984d638c
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce9990>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_4969d291c5793611e169a43057c87d52.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_4969d291c5793611e169a43057c87d52.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c61fd0>
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_2241dbcefa2d9e4fb1ea5cc0ed18b448.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_2241dbcefa2d9e4fb1ea5cc0ed18b448.jpg saved to cache
2026-03-28 20:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_a61ff517ac3a8169e4d8422dbbb6d457.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_8ba3bef787da310608dcfd2ef94970b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV90992> (referer: https://www.auto1.com/v1/car-details-view/FV90992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80301c2d0>
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_1e0b46fb213484761e16b20a0d063be2.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_1e0b46fb213484761e16b20a0d063be2.jpg saved to cache
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80301ec10>
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_7acdd8f99730034396aa741adf1f1c9f.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_7acdd8f99730034396aa741adf1f1c9f.jpg saved to cache
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b97ab06-82dc-5178-a422-0105984d638c
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_aed3b0ad3fc49c3aa2fda8a0ea684a18.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_17abdb58a041e56203bf5864a4a4e233.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a095afb57d94bdbbd4965b81e057380e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_47b34420b00dc730819f34521643c0cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_735a83c0f1b71290fbf628e0b78b917f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_ede7b2370958d4b40f198fbcdd444a85.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_b626d65e62ba3e9b36b2e3a3a0888ccf.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_52a195ca77059b5413c95ab6953ff5d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1094 | hits on page: 40
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df65d0>
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_a61ff517ac3a8169e4d8422dbbb6d457.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_a61ff517ac3a8169e4d8422dbbb6d457.jpg saved to cache
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b97ab06-82dc-5178-a422-0105984d638c
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a4f910>
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_8ba3bef787da310608dcfd2ef94970b8.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_8ba3bef787da310608dcfd2ef94970b8.jpg saved to cache
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b97ab06-82dc-5178-a422-0105984d638c
2026-03-28 20:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992
2026-03-28 20:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8523aa88-2017-5043-95f6-adce869f3380 with scrape type 1
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_41b9434fb8d24ec0629d492a36d37878.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_41b9434fb8d24ec0629d492a36d37878.jpg not downloaded yet
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for TC61218: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for PP72448: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for EV21741: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for BZ95673: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for AG16412: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for TM16327: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for UC18604: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for TF70513: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for ZD95004: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for PC01829: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for RW32127: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for CE27208: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for CG81228: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for WN54122: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for UA48921: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for RY49845: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for ZT87936: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for VZ26828: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for KR16689: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for YV20290: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for LK52725: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for TS84713: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for HY97997: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 20:37:50 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_6c5f618483d6b2cb55b4c53938931174.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6c5f618483d6b2cb55b4c53938931174.jpg not downloaded yet
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_eba3a353f60d919737bdff8065be7965.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_6d59a9bd2fe8ed4ae94ebd5e89f9e383.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6d59a9bd2fe8ed4ae94ebd5e89f9e383.jpg not downloaded yet
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_c2c0689685b94cc12ca6f7f19fdf2d55.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_0693111c07037efc1d61004da7218dbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_6ca19c587bdb9c51a787c38de8cad0bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_4ae0ccf8fa6aae3b74e7b0ec97257dc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a3bc90>
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_aed3b0ad3fc49c3aa2fda8a0ea684a18.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_aed3b0ad3fc49c3aa2fda8a0ea684a18.jpg saved to cache
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b97ab06-82dc-5178-a422-0105984d638c
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cc84d0>
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F03%252Fa50338885bc591d23baaf2117170af9b%252Fpa%252FDC62563_17abdb58a041e56203bf5864a4a4e233.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_17abdb58a041e56203bf5864a4a4e233.jpg saved to cache
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b97ab06-82dc-5178-a422-0105984d638c
2026-03-28 20:37:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b97ab06-82dc-5178-a422-0105984d638c, skipping ID generation
2026-03-28 20:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b97ab06-82dc-5178-a422-0105984d638c with scrape type 1
2026-03-28 20:37:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b97ab06-82dc-5178-a422-0105984d638c sending to next pipeline
2026-03-28 20:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b97ab06-82dc-5178-a422-0105984d638c, identifier: DC62563
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803af74d0>
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_a095afb57d94bdbbd4965b81e057380e.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a095afb57d94bdbbd4965b81e057380e.jpg saved to cache
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030f4050>
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_47b34420b00dc730819f34521643c0cc.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_47b34420b00dc730819f34521643c0cc.jpg saved to cache
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a59ed0>
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F3a%252Fee3ade877a376fbcbfe363e17b266add%252Fpa%252FKF94293_735a83c0f1b71290fbf628e0b78b917f.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_735a83c0f1b71290fbf628e0b78b917f.jpg saved to cache
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 830f3b14-21de-50cb-af11-f25c3a379396
2026-03-28 20:37:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 830f3b14-21de-50cb-af11-f25c3a379396, skipping ID generation
2026-03-28 20:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 830f3b14-21de-50cb-af11-f25c3a379396 with scrape type 1
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 830f3b14-21de-50cb-af11-f25c3a379396 sending to next pipeline
2026-03-28 20:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 830f3b14-21de-50cb-af11-f25c3a379396, identifier: KF94293
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803058d10>
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_ede7b2370958d4b40f198fbcdd444a85.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_ede7b2370958d4b40f198fbcdd444a85.jpg saved to cache
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030aac10>
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fb2%252F00b23c5cffba10af0a6e1ea428c15d67%252Fpa%252FAE63964_b626d65e62ba3e9b36b2e3a3a0888ccf.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_b626d65e62ba3e9b36b2e3a3a0888ccf.jpg saved to cache
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2
2026-03-28 20:37:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2, skipping ID generation
2026-03-28 20:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with scrape type 1
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 sending to next pipeline
2026-03-28 20:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2, identifier: AE63964
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b389d0>
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F35%252F8f356a2a3b8d0e1e0a603357394d409b%252Fpa%252FSX95001_52a195ca77059b5413c95ab6953ff5d7.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_52a195ca77059b5413c95ab6953ff5d7.jpg saved to cache
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355
2026-03-28 20:37:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8547ecd8-1b32-5201-8e25-fe5fd07e8355, skipping ID generation
2026-03-28 20:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with scrape type 1
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8547ecd8-1b32-5201-8e25-fe5fd07e8355 sending to next pipeline
2026-03-28 20:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8547ecd8-1b32-5201-8e25-fe5fd07e8355, identifier: SX95001
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_77285bcfa4dbd6808e3e3babddd44090.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_77285bcfa4dbd6808e3e3babddd44090.jpg not downloaded yet
2026-03-28 20:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:37:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 20:37:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563
2026-03-28 20:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b97ab06-82dc-5178-a422-0105984d638c with identifier: DC62563 to the API
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_17abdb58a041e56203bf5864a4a4e233.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:48:54Z',
 'fuel_type': 'petrol',
 'id': '2b97ab06-82dc-5178-a422-0105984d638c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC62563',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 146523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_87e2d2cc078c506cdd993ddf48a4b252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_7acdd8f99730034396aa741adf1f1c9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_8ba3bef787da310608dcfd2ef94970b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_a61ff517ac3a8169e4d8422dbbb6d457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_17abdb58a041e56203bf5864a4a4e233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b97ab06-82dc-5178-a422-0105984d638c/2b97ab06-82dc-5178-a422-0105984d638c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/03/a50338885bc591d23baaf2117170af9b/pa/DC62563_aed3b0ad3fc49c3aa2fda8a0ea684a18.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2008}
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-28 20:37:52 [auto1.be] INFO: Saving data for DC62563: {'created_time': 1774730272.421566, 'last_price_update_time': 1774730272.421579, 'auction_closing_time': 1774885734.0}
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC62563') HTTP/1.1" 204 0
2026-03-28 20:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293
2026-03-28 20:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293
2026-03-28 20:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 830f3b14-21de-50cb-af11-f25c3a379396 with identifier: KF94293 to the API
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_735a83c0f1b71290fbf628e0b78b917f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:45Z',
 'fuel_type': 'diesel',
 'id': '830f3b14-21de-50cb-af11-f25c3a379396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF94293',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 159312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a095afb57d94bdbbd4965b81e057380e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_f924b28ffe11725af229fe5e6613b65f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_b212e29e29624f8e51faf3d9cc1b03c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_278b1d093a27487506b8f74dc9906f9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_a3661f444f85511a5cb4e52258df5209.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_cf70f2879b5c876629d85a473b9403c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_503b1b8cc3ce728697b7dfff3516623b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_413d70adb18c793cf0a4ed292c67d2d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_ca27f824309c06765e87336cd5f37ee6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_830f3b14-21de-50cb-af11-f25c3a379396/830f3b14-21de-50cb-af11-f25c3a379396_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3524500,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/3a/ee3ade877a376fbcbfe363e17b266add/pa/KF94293_735a83c0f1b71290fbf628e0b78b917f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2013}
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-28 20:37:52 [auto1.be] INFO: Saving data for KF94293: {'created_time': 1774730272.890768, 'last_price_update_time': 1774730272.890781, 'auction_closing_time': 1774885005.0}
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF94293') HTTP/1.1" 204 0
2026-03-28 20:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964
2026-03-28 20:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964
2026-03-28 20:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2 with identifier: AE63964 to the API
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_b626d65e62ba3e9b36b2e3a3a0888ccf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:49:36Z',
 'fuel_type': 'petrol',
 'id': '4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE63964',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 135472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_47b34420b00dc730819f34521643c0cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_63b51c06d9465de5021ebc30936cdb22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_1e0b46fb213484761e16b20a0d063be2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_801b4e879f8b3b4885f9f2389e5fb366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_295fa7cdab9de43d5b313b3cc9cb3e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_2241dbcefa2d9e4fb1ea5cc0ed18b448.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_ede7b2370958d4b40f198fbcdd444a85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_b626d65e62ba3e9b36b2e3a3a0888ccf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_e44ed90a6f9f87c1e563488e54a0f9d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2/4d77b7a7-1b95-5d9f-bfa8-5b9e28da58c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/b2/00b23c5cffba10af0a6e1ea428c15d67/pa/AE63964_a9706651079aae5b683aa95520d7020b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.4 Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2011}
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-28 20:37:53 [auto1.be] INFO: Saving data for AE63964: {'created_time': 1774730273.243791, 'last_price_update_time': 1774730273.243805, 'auction_closing_time': 1774885776.0}
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE63964') HTTP/1.1" 204 0
2026-03-28 20:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001
2026-03-28 20:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001
2026-03-28 20:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8547ecd8-1b32-5201-8e25-fe5fd07e8355 with identifier: SX95001 to the API
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_52a195ca77059b5413c95ab6953ff5d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:25Z',
 'fuel_type': 'diesel',
 'id': '8547ecd8-1b32-5201-8e25-fe5fd07e8355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX95001',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 152790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417563,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_52a195ca77059b5413c95ab6953ff5d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_c62e0d18457e3892af12d79c8bdc868b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_4969d291c5793611e169a43057c87d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_84fe29bde7b3ef272eef6f4bf3d7b666.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_033cdea31d1dc1647a8b59a9a142d0fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_e1c3277337cccf2e1306e637c7d5cf9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_96d228a5593494507a5adc902f3b1c7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_63935c8bd48d1739700eb70136fbe972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_0ce7c56a53002244b8bb799cee9f2263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8547ecd8-1b32-5201-8e25-fe5fd07e8355/8547ecd8-1b32-5201-8e25-fe5fd07e8355_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/35/8f356a2a3b8d0e1e0a603357394d409b/pa/SX95001_6bda91a630fddb4f5d228f25ff8f7491.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2013}
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-28 20:37:53 [auto1.be] INFO: Saving data for SX95001: {'created_time': 1774730273.576379, 'last_price_update_time': 1774730273.576391, 'auction_closing_time': 1774884925.0}
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX95001') HTTP/1.1" 204 0
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_c73f56f938f3fb84089cd090a86cdc36.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_c73f56f938f3fb84089cd090a86cdc36.jpg not downloaded yet
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_8497d56a4bbf02267f447cc5340722f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_8497d56a4bbf02267f447cc5340722f3.jpg not downloaded yet
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f8a1d0>
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F80%252F8480b80b5b2a458713140db4a66d2a6d%252Fpa%252FKM81672_eba3a353f60d919737bdff8065be7965.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_eba3a353f60d919737bdff8065be7965.jpg saved to cache
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a
2026-03-28 20:37:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5d4fd65-25c0-53d8-871c-af4ee329ff5a, skipping ID generation
2026-03-28 20:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a with scrape type 1
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5d4fd65-25c0-53d8-871c-af4ee329ff5a sending to next pipeline
2026-03-28 20:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a5d4fd65-25c0-53d8-871c-af4ee329ff5a, identifier: KM81672
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f209d0>
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_c2c0689685b94cc12ca6f7f19fdf2d55.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_c2c0689685b94cc12ca6f7f19fdf2d55.jpg saved to cache
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c566c069-0a72-54bc-ab15-e9ef17b296a2
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b53350>
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_0693111c07037efc1d61004da7218dbd.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_0693111c07037efc1d61004da7218dbd.jpg saved to cache
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b530d0>
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_6ca19c587bdb9c51a787c38de8cad0bc.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_6ca19c587bdb9c51a787c38de8cad0bc.jpg saved to cache
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f23790>
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_4ae0ccf8fa6aae3b74e7b0ec97257dc3.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_4ae0ccf8fa6aae3b74e7b0ec97257dc3.jpg saved to cache
2026-03-28 20:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c566c069-0a72-54bc-ab15-e9ef17b296a2
2026-03-28 20:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672
2026-03-28 20:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672
2026-03-28 20:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a5d4fd65-25c0-53d8-871c-af4ee329ff5a with identifier: KM81672 to the API
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_eba3a353f60d919737bdff8065be7965.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:57Z',
 'fuel_type': 'diesel',
 'id': 'a5d4fd65-25c0-53d8-871c-af4ee329ff5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM81672',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 135532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_eba3a353f60d919737bdff8065be7965.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_2ced30faf86ddcfee7cb49191a86188f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_5d693c0534303288452b1b44b9fee407.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_595891078387ba4e9452ce9762150b25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_598a849dd6ba21eaa6f0b7b778cf55e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_86feccfe6df108e43a8da19f4a948e97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3317839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_d834bc7f6902b96f7edb96fddda850b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_80b6c0f707a7fd1f85a0a4846cb61384.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_afc8108a7c3f33171baabf84a272a5a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5d4fd65-25c0-53d8-871c-af4ee329ff5a/a5d4fd65-25c0-53d8-871c-af4ee329ff5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3226028,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/80/8480b80b5b2a458713140db4a66d2a6d/pa/KM81672_12fe81879251a7bb26388cd70ca21880.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2022}
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-28 20:37:54 [auto1.be] INFO: Saving data for KM81672: {'created_time': 1774730274.315873, 'last_price_update_time': 1774730274.315886, 'auction_closing_time': 1774884657.0}
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM81672') HTTP/1.1" 204 0
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_1d2873ea03787444f4a92c4e53505959.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_1d2873ea03787444f4a92c4e53505959.jpg not downloaded yet
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR33188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_b1ef89385d48673f9bcf91976082de36.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_b1ef89385d48673f9bcf91976082de36.jpg not downloaded yet
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_7c5d7df3ab14d2dd6ec772df0b84e4d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_7c5d7df3ab14d2dd6ec772df0b84e4d2.jpg not downloaded yet
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_41b9434fb8d24ec0629d492a36d37878.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_0b4dcfc7fdb26aa43d2a2d71c6f23f7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_0b4dcfc7fdb26aa43d2a2d71c6f23f7e.jpg not downloaded yet
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4dd017654820b46f3a54730bb6910a08.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_26e21e6138014184a3a3691cb359cb02.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK87235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ05954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6d59a9bd2fe8ed4ae94ebd5e89f9e383.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_77285bcfa4dbd6808e3e3babddd44090.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_c73f56f938f3fb84089cd090a86cdc36.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80309aad0>
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_41b9434fb8d24ec0629d492a36d37878.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_41b9434fb8d24ec0629d492a36d37878.jpg saved to cache
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6c5f618483d6b2cb55b4c53938931174.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_8701a1d9aa5fc110e925798f7c5353c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802faf250>
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F61%252Fdb61317709dabae9081ff03d7b47637c%252Fpa%252FBT48733_4dd017654820b46f3a54730bb6910a08.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4dd017654820b46f3a54730bb6910a08.jpg saved to cache
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24205427-2b64-5c45-941a-a84c4ee8095c
2026-03-28 20:37:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24205427-2b64-5c45-941a-a84c4ee8095c, skipping ID generation
2026-03-28 20:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24205427-2b64-5c45-941a-a84c4ee8095c with scrape type 1
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24205427-2b64-5c45-941a-a84c4ee8095c sending to next pipeline
2026-03-28 20:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24205427-2b64-5c45-941a-a84c4ee8095c, identifier: BT48733
2026-03-28 20:37:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80308fc10>
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_26e21e6138014184a3a3691cb359cb02.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_26e21e6138014184a3a3691cb359cb02.jpg saved to cache
2026-03-28 20:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733
2026-03-28 20:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733
2026-03-28 20:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24205427-2b64-5c45-941a-a84c4ee8095c with identifier: BT48733 to the API
2026-03-28 20:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4dd017654820b46f3a54730bb6910a08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:23:26Z',
 'fuel_type': 'petrol',
 'id': '24205427-2b64-5c45-941a-a84c4ee8095c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT48733',
 'listing': 'auction',
 'location': 'BE, Rochefort',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 51991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2402515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4dd017654820b46f3a54730bb6910a08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_a7a72613cfff9442a4d4273707f4c3b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_0693111c07037efc1d61004da7218dbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_4352ea2dedeb0904e67a110f8c52800b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2378761,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_341353d91cbaa33af7dfaa46b3cac511.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2381491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_3ccdb71a5a8d9eed4fe8f18c355b1ada.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_d1bb8c7b153eea612963730096145961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_26c744b71a2d83a68289f4a6b22ad615.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_bc9eb7f6dfcfb717bbb9b59e06141dfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24205427-2b64-5c45-941a-a84c4ee8095c/24205427-2b64-5c45-941a-a84c4ee8095c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/61/db61317709dabae9081ff03d7b47637c/pa/BT48733_30f6b80e54e06e5d2aa7ec1573b8488f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-28 20:37:55 [auto1.be] INFO: Saving data for BT48733: {'created_time': 1774730275.445991, 'last_price_update_time': 1774730275.446002, 'auction_closing_time': 1774884206.0}
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT48733') HTTP/1.1" 204 0
2026-03-28 20:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_3f519b5ff6490b3bb6c2ce488d697b5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031d3210>
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_6d59a9bd2fe8ed4ae94ebd5e89f9e383.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6d59a9bd2fe8ed4ae94ebd5e89f9e383.jpg saved to cache
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80308d150>
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_77285bcfa4dbd6808e3e3babddd44090.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_77285bcfa4dbd6808e3e3babddd44090.jpg saved to cache
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fb7e10>
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_c73f56f938f3fb84089cd090a86cdc36.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_c73f56f938f3fb84089cd090a86cdc36.jpg saved to cache
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811eb9a10>
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_6c5f618483d6b2cb55b4c53938931174.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6c5f618483d6b2cb55b4c53938931174.jpg saved to cache
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a25110>
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F66%252Ff166d1ea94d330784c6070aa87be5f21%252Fpa%252FLF44164_8701a1d9aa5fc110e925798f7c5353c2.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_8701a1d9aa5fc110e925798f7c5353c2.jpg saved to cache
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1
2026-03-28 20:37:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1, skipping ID generation
2026-03-28 20:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with scrape type 1
2026-03-28 20:37:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 sending to next pipeline
2026-03-28 20:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1, identifier: LF44164
2026-03-28 20:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164
2026-03-28 20:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164
2026-03-28 20:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1b7697c-9119-588c-8a4c-0f45ae3c3ae1 with identifier: LF44164 to the API
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_8701a1d9aa5fc110e925798f7c5353c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:01:31Z',
 'fuel_type': 'petrol',
 'id': 'c1b7697c-9119-588c-8a4c-0f45ae3c3ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF44164',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Fiat',
 'model': '500',
 'odometer': 79602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_febc45ec52c64bd3226ebce419cd5b9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_8701a1d9aa5fc110e925798f7c5353c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_26e21e6138014184a3a3691cb359cb02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5b7f309f3f784ff5ac417ad72e4c6f66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_6ca19c587bdb9c51a787c38de8cad0bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_54c9c07b828b85b204b9173999a0bef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1711972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_17fae794f51f090c1d2e2e4a1af471bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2254499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_5826c6bf5664fc27771c1280388197fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_a59ea44f40cebc83c69e3b4657465769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1b7697c-9119-588c-8a4c-0f45ae3c3ae1/c1b7697c-9119-588c-8a4c-0f45ae3c3ae1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/66/f166d1ea94d330784c6070aa87be5f21/pa/LF44164_21db5c1295417403246be830df7fe688.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2010}
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Saving data for LF44164: {'created_time': 1774730276.241131, 'last_price_update_time': 1774730276.241142, 'auction_closing_time': 1774882891.0}
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LF44164') HTTP/1.1" 204 0
2026-03-28 20:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ05274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803033a10>
2026-03-28 20:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F52%252F23529b6fe5a49ebf41779b89a9623194%252Fpa%252FSV00163_3f519b5ff6490b3bb6c2ce488d697b5c.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_3f519b5ff6490b3bb6c2ce488d697b5c.jpg saved to cache
2026-03-28 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c566c069-0a72-54bc-ab15-e9ef17b296a2
2026-03-28 20:37:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c566c069-0a72-54bc-ab15-e9ef17b296a2, skipping ID generation
2026-03-28 20:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c566c069-0a72-54bc-ab15-e9ef17b296a2 with scrape type 1
2026-03-28 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c566c069-0a72-54bc-ab15-e9ef17b296a2 sending to next pipeline
2026-03-28 20:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c566c069-0a72-54bc-ab15-e9ef17b296a2, identifier: SV00163
2026-03-28 20:37:56 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1094 | hits on page: 14
2026-03-28 20:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163
2026-03-28 20:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163
2026-03-28 20:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c566c069-0a72-54bc-ab15-e9ef17b296a2 with identifier: SV00163 to the API
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_3f519b5ff6490b3bb6c2ce488d697b5c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:40:17Z',
 'fuel_type': 'petrol',
 'id': 'c566c069-0a72-54bc-ab15-e9ef17b296a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV00163',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 166532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_0c1836735a2e3ba8f414618b99d0c8de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_3f519b5ff6490b3bb6c2ce488d697b5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_c2c0689685b94cc12ca6f7f19fdf2d55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_f8c06dd33c9d090fe1959f99f2e67eee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_4ae0ccf8fa6aae3b74e7b0ec97257dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c566c069-0a72-54bc-ab15-e9ef17b296a2/c566c069-0a72-54bc-ab15-e9ef17b296a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/52/23529b6fe5a49ebf41779b89a9623194/pa/SV00163_9c6600f25c0fe5bab271ae2f8f0b1f1d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Saving data for SV00163: {'created_time': 1774730276.738855, 'last_price_update_time': 1774730276.738866, 'auction_closing_time': 1774885217.0}
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV00163') HTTP/1.1" 204 0
2026-03-28 20:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Scrape type for BR73229: 0
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Scrape type for BB63081: 0
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Scrape type for XR93319: 0
2026-03-28 20:37:56 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-28 20:37:56 [auto1.be] INFO: Scrape type for AB98915: 2
2026-03-28 20:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-28 20:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b71501c-e35f-5284-9543-b5c40ad92f2c with scrape type 2
2026-03-28 20:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b71501c-e35f-5284-9543-b5c40ad92f2c with scrape type 2
2026-03-28 20:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b71501c-e35f-5284-9543-b5c40ad92f2c, identifier: AB98915
2026-03-28 20:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-28 20:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-28 20:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915 to the API
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:01Z',
 'fuel_type': 'diesel',
 'id': '4b71501c-e35f-5284-9543-b5c40ad92f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB98915',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 144079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Origin',
 'transmission': 'manual',
 'trim': 'Origin',
 'year': 2014}
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-28 20:37:57 [auto1.be] INFO: Saving data for AB98915: {'auction_closing_time': 1774886161.0, 'created_time': 1774298302.753147, 'last_price_update_time': 1774730277.289514}
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB98915') HTTP/1.1" 204 0
2026-03-28 20:37:57 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 20:37:57 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 20:37:57 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-28 20:37:57 [auto1.be] INFO: Scrape type for XL09418: 2
2026-03-28 20:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-28 20:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with scrape type 2
2026-03-28 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with scrape type 2
2026-03-28 20:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20d094a7-5388-5a8e-97d5-c729ff5bdc54, identifier: XL09418
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_45421a97f569ad98e3995ad4817a9b14.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-28 20:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-28 20:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418 to the API
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:38Z',
 'fuel_type': 'diesel',
 'id': '20d094a7-5388-5a8e-97d5-c729ff5bdc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL09418',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 151368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-05',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 2,9t Authentique',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Authentique',
 'year': 2012}
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-28 20:37:57 [auto1.be] INFO: Saving data for XL09418: {'auction_closing_time': 1774885298.0, 'created_time': 1774298275.949361, 'last_price_update_time': 1774730277.719604}
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL09418') HTTP/1.1" 204 0
2026-03-28 20:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_824e7e75833826462b03ea3eca3fac6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_652f5b718bd4790780af82f81b760009.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_b1ef89385d48673f9bcf91976082de36.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a31150>
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_45421a97f569ad98e3995ad4817a9b14.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_45421a97f569ad98e3995ad4817a9b14.jpg saved to cache
2026-03-28 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_8ece123f77e33736696a5831bfc5eeb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_1d2873ea03787444f4a92c4e53505959.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_7c5d7df3ab14d2dd6ec772df0b84e4d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_0b4dcfc7fdb26aa43d2a2d71c6f23f7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_8497d56a4bbf02267f447cc5340722f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_6bbb4c89563b12d04f333369af4b635f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_442359ddec158ebcc1c14da209c09612.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803068a90>
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_824e7e75833826462b03ea3eca3fac6b.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_824e7e75833826462b03ea3eca3fac6b.jpg saved to cache
2026-03-28 20:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_a6b7374a3ed3fc4882681a9103e5a574.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_7526189e9b26a6e157ec89806473064a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c628d0>
2026-03-28 20:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_652f5b718bd4790780af82f81b760009.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_652f5b718bd4790780af82f81b760009.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a33590>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_b1ef89385d48673f9bcf91976082de36.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_b1ef89385d48673f9bcf91976082de36.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a242d0>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_8ece123f77e33736696a5831bfc5eeb1.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_8ece123f77e33736696a5831bfc5eeb1.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c6f550>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_1d2873ea03787444f4a92c4e53505959.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_1d2873ea03787444f4a92c4e53505959.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803135850>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_7c5d7df3ab14d2dd6ec772df0b84e4d2.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_7c5d7df3ab14d2dd6ec772df0b84e4d2.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031363d0>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_0b4dcfc7fdb26aa43d2a2d71c6f23f7e.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_0b4dcfc7fdb26aa43d2a2d71c6f23f7e.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030dd2d0>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F16%252Fdc1658f2a0fdeaf249fcae03c374871a%252Fpa%252FFV90992_8497d56a4bbf02267f447cc5340722f3.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_8497d56a4bbf02267f447cc5340722f3.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8523aa88-2017-5043-95f6-adce869f3380
2026-03-28 20:37:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8523aa88-2017-5043-95f6-adce869f3380, skipping ID generation
2026-03-28 20:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8523aa88-2017-5043-95f6-adce869f3380 with scrape type 1
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8523aa88-2017-5043-95f6-adce869f3380 sending to next pipeline
2026-03-28 20:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8523aa88-2017-5043-95f6-adce869f3380, identifier: FV90992
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803121e50>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_6bbb4c89563b12d04f333369af4b635f.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_6bbb4c89563b12d04f333369af4b635f.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306a950>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_442359ddec158ebcc1c14da209c09612.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_442359ddec158ebcc1c14da209c09612.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1c2d0>
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_a6b7374a3ed3fc4882681a9103e5a574.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_a6b7374a3ed3fc4882681a9103e5a574.jpg saved to cache
2026-03-28 20:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992
2026-03-28 20:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992
2026-03-28 20:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8523aa88-2017-5043-95f6-adce869f3380 with identifier: FV90992 to the API
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_8497d56a4bbf02267f447cc5340722f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:06:38Z',
 'fuel_type': 'petrol',
 'id': '8523aa88-2017-5043-95f6-adce869f3380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV90992',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 87048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_41b9434fb8d24ec0629d492a36d37878.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6c5f618483d6b2cb55b4c53938931174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_6d59a9bd2fe8ed4ae94ebd5e89f9e383.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_77285bcfa4dbd6808e3e3babddd44090.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_c73f56f938f3fb84089cd090a86cdc36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_8497d56a4bbf02267f447cc5340722f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2297371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_1d2873ea03787444f4a92c4e53505959.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_b1ef89385d48673f9bcf91976082de36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_7c5d7df3ab14d2dd6ec772df0b84e4d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8523aa88-2017-5043-95f6-adce869f3380/8523aa88-2017-5043-95f6-adce869f3380_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2938718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/16/dc1658f2a0fdeaf249fcae03c374871a/pa/FV90992_0b4dcfc7fdb26aa43d2a2d71c6f23f7e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2015}
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [auto1.be] INFO: Saving data for FV90992: {'created_time': 1774730279.317328, 'last_price_update_time': 1774730279.317338, 'auction_closing_time': 1774883198.0}
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV90992') HTTP/1.1" 204 0
2026-03-28 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ05954> (referer: https://www.auto1.com/v1/car-details-view/SJ05954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP00364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK87235> (referer: https://www.auto1.com/v1/car-details-view/HK87235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR33188> (referer: https://www.auto1.com/v1/car-details-view/UR33188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC33060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:37:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:37:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803127510>
2026-03-28 20:37:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:37:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_7526189e9b26a6e157ec89806473064a.jpg') HTTP/1.1" 204 0
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_7526189e9b26a6e157ec89806473064a.jpg saved to cache
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954
2026-03-28 20:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13b0eda-93fc-5b98-8fda-c0484df24600 with scrape type 1
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e13b0eda-93fc-5b98-8fda-c0484df24600
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_5e74ee058e9905dee6b3f85896e473db.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_5e74ee058e9905dee6b3f85896e473db.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_34c604a4c20acadb28b2913a32022c54.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_34c604a4c20acadb28b2913a32022c54.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_738c3b37e6bef2d6fa152440e45ad68b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_738c3b37e6bef2d6fa152440e45ad68b.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_871e7f398fd5f8b6690fad9af3fa76d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_871e7f398fd5f8b6690fad9af3fa76d3.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_f5081f76b3d39db979f06043af268aad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_f5081f76b3d39db979f06043af268aad.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_3fdc56b971da974444a6382f3d93a708.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_3fdc56b971da974444a6382f3d93a708.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_0f3d6655723fc89cc28d3ec4e1257712.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_0f3d6655723fc89cc28d3ec4e1257712.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_ce4cadecaca68954e8dccce04e4dde65.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_ce4cadecaca68954e8dccce04e4dde65.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_d05eb170a661e33d3bea023da60c95b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_d05eb170a661e33d3bea023da60c95b8.jpg already downloaded
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F96%252Fd99670f969ed847a52bd5c2c796bd888%252Fpa%252FSJ05954_8abaf33870386bfd65b8ce246936ac69.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_8abaf33870386bfd65b8ce246936ac69.jpg already downloaded
2026-03-28 20:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e13b0eda-93fc-5b98-8fda-c0484df24600, identifier: SJ05954
2026-03-28 20:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235
2026-03-28 20:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d8eb18-487e-5954-a26d-1588a8718da3 with scrape type 1
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_367e046eebd78a86067129d7fe43b72a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_367e046eebd78a86067129d7fe43b72a.jpg not downloaded yet
2026-03-28 20:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954
2026-03-28 20:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954
2026-03-28 20:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e13b0eda-93fc-5b98-8fda-c0484df24600 with identifier: SJ05954 to the API
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ05954>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:32Z',
 'fuel_type': 'diesel',
 'id': 'e13b0eda-93fc-5b98-8fda-c0484df24600',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ05954',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 154257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_5e74ee058e9905dee6b3f85896e473db.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_34c604a4c20acadb28b2913a32022c54.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_738c3b37e6bef2d6fa152440e45ad68b.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_871e7f398fd5f8b6690fad9af3fa76d3.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_f5081f76b3d39db979f06043af268aad.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_3fdc56b971da974444a6382f3d93a708.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_0f3d6655723fc89cc28d3ec4e1257712.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_ce4cadecaca68954e8dccce04e4dde65.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_d05eb170a661e33d3bea023da60c95b8.jpg',
                'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_8abaf33870386bfd65b8ce246936ac69.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_5e74ee058e9905dee6b3f85896e473db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_34c604a4c20acadb28b2913a32022c54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_738c3b37e6bef2d6fa152440e45ad68b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_871e7f398fd5f8b6690fad9af3fa76d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_f5081f76b3d39db979f06043af268aad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_3fdc56b971da974444a6382f3d93a708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_0f3d6655723fc89cc28d3ec4e1257712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_ce4cadecaca68954e8dccce04e4dde65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_d05eb170a661e33d3bea023da60c95b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e13b0eda-93fc-5b98-8fda-c0484df24600/e13b0eda-93fc-5b98-8fda-c0484df24600_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/96/d99670f969ed847a52bd5c2c796bd888/pa/SJ05954_8abaf33870386bfd65b8ce246936ac69.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [auto1.be] INFO: Saving data for SJ05954: {'created_time': 1774730280.088152, 'last_price_update_time': 1774730280.088164, 'auction_closing_time': 1774884032.0}
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ05954') HTTP/1.1" 204 0
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_7e27bfed9d58787a1175ae92e9dac49e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_29c247e6ee8b1f5e37c28346f6fb995a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_3923be48f1e5f2e7c69edaddfc9fd9fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_5a0a432fab52f0a1d83cad263c5aee13.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_5a0a432fab52f0a1d83cad263c5aee13.jpg not downloaded yet
2026-03-28 20:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188
2026-03-28 20:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76ce2efc-ff21-5895-82b1-00fbe104962f with scrape type 1
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76ce2efc-ff21-5895-82b1-00fbe104962f
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_36b34336e5b0157b1fe094ac961f5e42.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_36b34336e5b0157b1fe094ac961f5e42.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_5c9f4b35825ff0de4c75f1b113a04c16.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_5c9f4b35825ff0de4c75f1b113a04c16.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_5f5374178849845ff0ecf81582f48f1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_5f5374178849845ff0ecf81582f48f1d.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_98373fe0141a554c06a2730eef6c1006.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_98373fe0141a554c06a2730eef6c1006.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_83ee78c10f7e820b6d43405e06b1e82c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_83ee78c10f7e820b6d43405e06b1e82c.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_964887ddaffd4351234f962756c881bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_964887ddaffd4351234f962756c881bb.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_dd3de39106ed91db7c8db78548036489.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_dd3de39106ed91db7c8db78548036489.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_e87473ae177aa41cd9cbe870847df72e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_e87473ae177aa41cd9cbe870847df72e.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_0ae9f29eb013bda6823817094387d876.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_0ae9f29eb013bda6823817094387d876.jpg already downloaded
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fc1%252F90c1f97094ad14c85964d7e7ba6846d7%252Fpa%252FUR33188_2fc940d43fcf9795ed3b5cdc93e6f95a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_2fc940d43fcf9795ed3b5cdc93e6f95a.jpg already downloaded
2026-03-28 20:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76ce2efc-ff21-5895-82b1-00fbe104962f, identifier: UR33188
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_d1e7cbb2ee14a88c4b57c85134e35b72.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_b190fed386b82412fe179525edfe42c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_525a495dc716ec6d96a7293f238c7d24.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188
2026-03-28 20:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188
2026-03-28 20:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76ce2efc-ff21-5895-82b1-00fbe104962f with identifier: UR33188 to the API
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UR33188>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:12:54Z',
 'fuel_type': 'diesel',
 'id': '76ce2efc-ff21-5895-82b1-00fbe104962f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR33188',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 137250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_36b34336e5b0157b1fe094ac961f5e42.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_5c9f4b35825ff0de4c75f1b113a04c16.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_5f5374178849845ff0ecf81582f48f1d.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_98373fe0141a554c06a2730eef6c1006.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_83ee78c10f7e820b6d43405e06b1e82c.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_964887ddaffd4351234f962756c881bb.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_dd3de39106ed91db7c8db78548036489.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_e87473ae177aa41cd9cbe870847df72e.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_0ae9f29eb013bda6823817094387d876.jpg',
                'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_2fc940d43fcf9795ed3b5cdc93e6f95a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_36b34336e5b0157b1fe094ac961f5e42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_5c9f4b35825ff0de4c75f1b113a04c16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_5f5374178849845ff0ecf81582f48f1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_98373fe0141a554c06a2730eef6c1006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_83ee78c10f7e820b6d43405e06b1e82c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_964887ddaffd4351234f962756c881bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_dd3de39106ed91db7c8db78548036489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_e87473ae177aa41cd9cbe870847df72e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_0ae9f29eb013bda6823817094387d876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76ce2efc-ff21-5895-82b1-00fbe104962f/76ce2efc-ff21-5895-82b1-00fbe104962f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/c1/90c1f97094ad14c85964d7e7ba6846d7/pa/UR33188_2fc940d43fcf9795ed3b5cdc93e6f95a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 C V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 C V Radstand 3520 L',
 'year': 2019}
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [auto1.be] INFO: Saving data for UR33188: {'created_time': 1774730280.713226, 'last_price_update_time': 1774730280.713237, 'auction_closing_time': 1774883574.0}
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR33188') HTTP/1.1" 204 0
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_36d9d43d409ebbf0290e6dde448f64d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_36d9d43d409ebbf0290e6dde448f64d5.jpg not downloaded yet
2026-03-28 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT63704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b51b10>
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_7e27bfed9d58787a1175ae92e9dac49e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_7e27bfed9d58787a1175ae92e9dac49e.jpg saved to cache
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a4d790>
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_29c247e6ee8b1f5e37c28346f6fb995a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_29c247e6ee8b1f5e37c28346f6fb995a.jpg saved to cache
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b38ad0>
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_3923be48f1e5f2e7c69edaddfc9fd9fe.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_3923be48f1e5f2e7c69edaddfc9fd9fe.jpg saved to cache
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_c8610d9cf685abc9ff55ef4bf91fa618.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_c8610d9cf685abc9ff55ef4bf91fa618.jpg not downloaded yet
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_367e046eebd78a86067129d7fe43b72a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_862c044a5a65200ad85cb3a0f4b8d765.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cb7cd0>
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_d1e7cbb2ee14a88c4b57c85134e35b72.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_d1e7cbb2ee14a88c4b57c85134e35b72.jpg saved to cache
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce3e90>
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_b190fed386b82412fe179525edfe42c3.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_b190fed386b82412fe179525edfe42c3.jpg saved to cache
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80308fed0>
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F04%252F5004b52feaabd4e47d6a71a6c01b5a43%252Fpa%252FTF43790_525a495dc716ec6d96a7293f238c7d24.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_525a495dc716ec6d96a7293f238c7d24.jpg saved to cache
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21a70cb9-5cef-5226-a478-6868bba028a7
2026-03-28 20:38:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21a70cb9-5cef-5226-a478-6868bba028a7, skipping ID generation
2026-03-28 20:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a70cb9-5cef-5226-a478-6868bba028a7 with scrape type 1
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21a70cb9-5cef-5226-a478-6868bba028a7 sending to next pipeline
2026-03-28 20:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21a70cb9-5cef-5226-a478-6868bba028a7, identifier: TF43790
2026-03-28 20:38:01 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1094 | hits on page: 0
2026-03-28 20:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_bfd9ab9ec4395a86541c88830e2c60da.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_ed1849570e20837bc2d8db80fdd25413.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_ed1849570e20837bc2d8db80fdd25413.jpg not downloaded yet
2026-03-28 20:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790
2026-03-28 20:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790
2026-03-28 20:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21a70cb9-5cef-5226-a478-6868bba028a7 with identifier: TF43790 to the API
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_525a495dc716ec6d96a7293f238c7d24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:02:13Z',
 'fuel_type': 'diesel',
 'id': '21a70cb9-5cef-5226-a478-6868bba028a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF43790',
 'listing': 'auction',
 'location': 'BE, Wanze',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 200822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_29c247e6ee8b1f5e37c28346f6fb995a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_7e27bfed9d58787a1175ae92e9dac49e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_525a495dc716ec6d96a7293f238c7d24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_141f60cef8a1ad5ba1b90a23e0fb6faa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_6bbb4c89563b12d04f333369af4b635f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_8ece123f77e33736696a5831bfc5eeb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_45421a97f569ad98e3995ad4817a9b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_40e4c9ffa866ab07bda4dd826bd2e093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_2efb68f6417523ce79022c59c4223ffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a70cb9-5cef-5226-a478-6868bba028a7/21a70cb9-5cef-5226-a478-6868bba028a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/04/5004b52feaabd4e47d6a71a6c01b5a43/pa/TF43790_652f5b718bd4790780af82f81b760009.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Tonic',
 'transmission': 'manual',
 'trim': 'Tonic',
 'year': 2014}
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-28 20:38:01 [auto1.be] INFO: Saving data for TF43790: {'created_time': 1774730281.603616, 'last_price_update_time': 1774730281.60363, 'auction_closing_time': 1774882933.0}
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF43790') HTTP/1.1" 204 0
2026-03-28 20:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_5a0a432fab52f0a1d83cad263c5aee13.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_e1ee194161d5312f1c889754459ecd93.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_e1ee194161d5312f1c889754459ecd93.jpg not downloaded yet
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1f050>
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_367e046eebd78a86067129d7fe43b72a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_367e046eebd78a86067129d7fe43b72a.jpg saved to cache
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031d0ad0>
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_862c044a5a65200ad85cb3a0f4b8d765.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_862c044a5a65200ad85cb3a0f4b8d765.jpg saved to cache
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR48094/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ05274> (referer: https://www.auto1.com/v1/car-details-view/KZ05274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df56d0>
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Ffa%252F5ffaed9a0dc20b923e41a4fad2cdfca8%252Fpa%252FFT86060_bfd9ab9ec4395a86541c88830e2c60da.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_bfd9ab9ec4395a86541c88830e2c60da.jpg saved to cache
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32
2026-03-28 20:38:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32, skipping ID generation
2026-03-28 20:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with scrape type 1
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 sending to next pipeline
2026-03-28 20:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32, identifier: FT86060
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_55e144ee784cf4e0dcad44461c93e41d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_55e144ee784cf4e0dcad44461c93e41d.jpg not downloaded yet
2026-03-28 20:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060
2026-03-28 20:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060
2026-03-28 20:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32 with identifier: FT86060 to the API
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_bfd9ab9ec4395a86541c88830e2c60da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:48:34Z',
 'fuel_type': 'diesel',
 'id': 'a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT86060',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 87476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_bfd9ab9ec4395a86541c88830e2c60da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_862c044a5a65200ad85cb3a0f4b8d765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_b190fed386b82412fe179525edfe42c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_3923be48f1e5f2e7c69edaddfc9fd9fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_d1e7cbb2ee14a88c4b57c85134e35b72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_a6b7374a3ed3fc4882681a9103e5a574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_7526189e9b26a6e157ec89806473064a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_442359ddec158ebcc1c14da209c09612.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_824e7e75833826462b03ea3eca3fac6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32/a372b0bd-cd1b-5fa0-96c2-8c9a59f85d32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/fa/5ffaed9a0dc20b923e41a4fad2cdfca8/pa/FT86060_c3025cb483bb24cc02cdd39ddebe00d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [auto1.be] INFO: Saving data for FT86060: {'created_time': 1774730282.264206, 'last_price_update_time': 1774730282.264221, 'auction_closing_time': 1774885714.0}
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT86060') HTTP/1.1" 204 0
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a30ad0>
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_5a0a432fab52f0a1d83cad263c5aee13.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_5a0a432fab52f0a1d83cad263c5aee13.jpg saved to cache
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_1c66de593d0f9c2a4e19c5a1d9569b68.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_1c66de593d0f9c2a4e19c5a1d9569b68.jpg not downloaded yet
2026-03-28 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF30779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT53046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW96446> (referer: https://www.auto1.com/v1/car-details-view/YW96446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_ed1849570e20837bc2d8db80fdd25413.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_a34c73d6758ff0597934d48fcf189d05.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_a34c73d6758ff0597934d48fcf189d05.jpg not downloaded yet
2026-03-28 20:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274
2026-03-28 20:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with scrape type 1
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_422a88a796338eb3666405aa63471b31.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_422a88a796338eb3666405aa63471b31.jpg not downloaded yet
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_2dc6795dc37415774a457322801d501d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_2dc6795dc37415774a457322801d501d.jpg not downloaded yet
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_42a1fd31ff0957dd9a40ba0a13926758.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_42a1fd31ff0957dd9a40ba0a13926758.jpg not downloaded yet
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_99e8983afb1b8c64e985bac18df1ca77.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_99e8983afb1b8c64e985bac18df1ca77.jpg not downloaded yet
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_6d26e440ad0b12dfd9d97c4afce5971a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_6d26e440ad0b12dfd9d97c4afce5971a.jpg not downloaded yet
2026-03-28 20:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446
2026-03-28 20:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with scrape type 1
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_4f0293d7c4d3275fa8be006be646f9f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_4f0293d7c4d3275fa8be006be646f9f6.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_ac6bd9bffab6552e31ecd4e725fb7ea9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_ac6bd9bffab6552e31ecd4e725fb7ea9.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_bc948dd2551a34630a4e0a1dee1e7658.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_bc948dd2551a34630a4e0a1dee1e7658.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_02974e791448eb9d802aa240075c370b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_02974e791448eb9d802aa240075c370b.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_4fc8254e32398778564e157833585b42.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_4fc8254e32398778564e157833585b42.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_b110ffb73aec1efad61a2c19f80bb4c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_b110ffb73aec1efad61a2c19f80bb4c9.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_d2bf59358c5d84d08cea45e7d313a1cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_d2bf59358c5d84d08cea45e7d313a1cd.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_88439b151e7bc6fe12faaf69751d4ca6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_88439b151e7bc6fe12faaf69751d4ca6.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_661b8ba5b3522010d42c986f744c9104.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_661b8ba5b3522010d42c986f744c9104.jpg already downloaded
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F13%252F7013facb7a6bdf831b58f5f1061fc2db%252Fpa%252FYW96446_7600cdb63852a7aacf9e14d089a3e439.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_7600cdb63852a7aacf9e14d089a3e439.jpg already downloaded
2026-03-28 20:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf, identifier: YW96446
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803099a90>
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_ed1849570e20837bc2d8db80fdd25413.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_ed1849570e20837bc2d8db80fdd25413.jpg saved to cache
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_81b9c27779ca849c1a51c1c94d6ab457.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_81b9c27779ca849c1a51c1c94d6ab457.jpg not downloaded yet
2026-03-28 20:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446
2026-03-28 20:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446
2026-03-28 20:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf with identifier: YW96446 to the API
2026-03-28 20:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW96446>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:16Z',
 'fuel_type': 'diesel',
 'id': '63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW96446',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 185780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_4f0293d7c4d3275fa8be006be646f9f6.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_ac6bd9bffab6552e31ecd4e725fb7ea9.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_bc948dd2551a34630a4e0a1dee1e7658.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_02974e791448eb9d802aa240075c370b.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_4fc8254e32398778564e157833585b42.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_b110ffb73aec1efad61a2c19f80bb4c9.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_d2bf59358c5d84d08cea45e7d313a1cd.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_88439b151e7bc6fe12faaf69751d4ca6.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_661b8ba5b3522010d42c986f744c9104.jpg',
                'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_7600cdb63852a7aacf9e14d089a3e439.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2204789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_4f0293d7c4d3275fa8be006be646f9f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_ac6bd9bffab6552e31ecd4e725fb7ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2090816,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_bc948dd2551a34630a4e0a1dee1e7658.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2025167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_02974e791448eb9d802aa240075c370b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_4fc8254e32398778564e157833585b42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2185305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_b110ffb73aec1efad61a2c19f80bb4c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2223792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_d2bf59358c5d84d08cea45e7d313a1cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_88439b151e7bc6fe12faaf69751d4ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2165247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_661b8ba5b3522010d42c986f744c9104.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf/63f90966-e80a-5e7d-bfa4-ce7dc1bc0fbf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/13/7013facb7a6bdf831b58f5f1061fc2db/pa/YW96446_7600cdb63852a7aacf9e14d089a3e439.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Evalia Acenta',
 'transmission': 'manual',
 'trim': 'Evalia Acenta',
 'year': 2013}
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [auto1.be] INFO: Saving data for YW96446: {'created_time': 1774730283.211219, 'last_price_update_time': 1774730283.211232, 'auction_closing_time': 1774883836.0}
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW96446') HTTP/1.1" 204 0
2026-03-28 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_55e144ee784cf4e0dcad44461c93e41d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_1c66de593d0f9c2a4e19c5a1d9569b68.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_a7b9778da1d5fd12c7f88fa8b415a7f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a7b9778da1d5fd12c7f88fa8b415a7f4.jpg not downloaded yet
2026-03-28 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE64828> (referer: https://www.auto1.com/v1/car-details-view/UE64828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_d38e8eef951c2814dd72af731682a81e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_d38e8eef951c2814dd72af731682a81e.jpg not downloaded yet
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_a81b2f308a888e4da5e7e54c6e018cf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a81b2f308a888e4da5e7e54c6e018cf7.jpg not downloaded yet
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_e8d6d6644a89e44b47652eaba30d2aba.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_e8d6d6644a89e44b47652eaba30d2aba.jpg not downloaded yet
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_29cf7335401a7bbc2e610b5697432c3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_29cf7335401a7bbc2e610b5697432c3e.jpg not downloaded yet
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f3af10>
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_55e144ee784cf4e0dcad44461c93e41d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_55e144ee784cf4e0dcad44461c93e41d.jpg saved to cache
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803054b90>
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_1c66de593d0f9c2a4e19c5a1d9569b68.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_1c66de593d0f9c2a4e19c5a1d9569b68.jpg saved to cache
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC08569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG38275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828
2026-03-28 20:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f450e3-7457-5d77-9aee-a84b8a5feff9 with scrape type 1
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 52f450e3-7457-5d77-9aee-a84b8a5feff9
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F33%252Ff933cae7de284cb74a0b4d9b505ce0e3%252Fpa%252FUE64828_363a5da781ee46afcea9e3ca1db03839.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_363a5da781ee46afcea9e3ca1db03839.jpg already downloaded
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F33%252Ff933cae7de284cb74a0b4d9b505ce0e3%252Fpa%252FUE64828_7a5a33aeb1767df1f17b90fb5e65b2e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_7a5a33aeb1767df1f17b90fb5e65b2e2.jpg already downloaded
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F33%252Ff933cae7de284cb74a0b4d9b505ce0e3%252Fpa%252FUE64828_b6d0feedf0d1f418778ffd4c8d280271.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_b6d0feedf0d1f418778ffd4c8d280271.jpg already downloaded
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F33%252Ff933cae7de284cb74a0b4d9b505ce0e3%252Fpa%252FUE64828_ba3facae4822eb019e925f2519fad03d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_ba3facae4822eb019e925f2519fad03d.jpg already downloaded
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F33%252Ff933cae7de284cb74a0b4d9b505ce0e3%252Fpa%252FUE64828_d28a1694d6cd94f99a31e68bfa481e17.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_d28a1694d6cd94f99a31e68bfa481e17.jpg already downloaded
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F33%252Ff933cae7de284cb74a0b4d9b505ce0e3%252Fpa%252FUE64828_05319606fd2d9541d1e4357b4134ffb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_05319606fd2d9541d1e4357b4134ffb7.jpg already downloaded
2026-03-28 20:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52f450e3-7457-5d77-9aee-a84b8a5feff9, identifier: UE64828
2026-03-28 20:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828
2026-03-28 20:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828
2026-03-28 20:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52f450e3-7457-5d77-9aee-a84b8a5feff9 with identifier: UE64828 to the API
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UE64828>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:50:11Z',
 'fuel_type': 'diesel',
 'id': '52f450e3-7457-5d77-9aee-a84b8a5feff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE64828',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 202319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_363a5da781ee46afcea9e3ca1db03839.jpg',
                'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_7a5a33aeb1767df1f17b90fb5e65b2e2.jpg',
                'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_b6d0feedf0d1f418778ffd4c8d280271.jpg',
                'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_ba3facae4822eb019e925f2519fad03d.jpg',
                'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_d28a1694d6cd94f99a31e68bfa481e17.jpg',
                'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_05319606fd2d9541d1e4357b4134ffb7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f450e3-7457-5d77-9aee-a84b8a5feff9/52f450e3-7457-5d77-9aee-a84b8a5feff9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_363a5da781ee46afcea9e3ca1db03839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f450e3-7457-5d77-9aee-a84b8a5feff9/52f450e3-7457-5d77-9aee-a84b8a5feff9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_7a5a33aeb1767df1f17b90fb5e65b2e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f450e3-7457-5d77-9aee-a84b8a5feff9/52f450e3-7457-5d77-9aee-a84b8a5feff9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_b6d0feedf0d1f418778ffd4c8d280271.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f450e3-7457-5d77-9aee-a84b8a5feff9/52f450e3-7457-5d77-9aee-a84b8a5feff9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_ba3facae4822eb019e925f2519fad03d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f450e3-7457-5d77-9aee-a84b8a5feff9/52f450e3-7457-5d77-9aee-a84b8a5feff9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_d28a1694d6cd94f99a31e68bfa481e17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52f450e3-7457-5d77-9aee-a84b8a5feff9/52f450e3-7457-5d77-9aee-a84b8a5feff9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/33/f933cae7de284cb74a0b4d9b505ce0e3/pa/UE64828_05319606fd2d9541d1e4357b4134ffb7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [auto1.be] INFO: Saving data for UE64828: {'created_time': 1774730284.072501, 'last_price_update_time': 1774730284.072513, 'auction_closing_time': 1774885811.0}
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UE64828') HTTP/1.1" 204 0
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP00364> (referer: https://www.auto1.com/v1/car-details-view/EP00364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_c8610d9cf685abc9ff55ef4bf91fa618.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN28044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC33060> (referer: https://www.auto1.com/v1/car-details-view/BC33060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_36d9d43d409ebbf0290e6dde448f64d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_e1ee194161d5312f1c889754459ecd93.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_81b9c27779ca849c1a51c1c94d6ab457.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW40078> (referer: https://www.auto1.com/v1/car-details-view/ZW40078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364
2026-03-28 20:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 906e976f-cfb4-5d17-8a93-23a374ca7175 with scrape type 1
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 906e976f-cfb4-5d17-8a93-23a374ca7175
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_5da2352db6def0d3a1662f60c959e526.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_5da2352db6def0d3a1662f60c959e526.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_e28cb6a6f8d969ef1d6a7690940fb93f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_e28cb6a6f8d969ef1d6a7690940fb93f.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_bb8f76f4a74cd0fe26901f0003dc475b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_bb8f76f4a74cd0fe26901f0003dc475b.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_9e47cb02faf1c03ea1784bc534e38134.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_9e47cb02faf1c03ea1784bc534e38134.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_d2052e9b2a3a7c9ef8ee046d4db3d5b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_d2052e9b2a3a7c9ef8ee046d4db3d5b9.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_c95eb5f6cbd240a83cca8ecc91c2da45.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_c95eb5f6cbd240a83cca8ecc91c2da45.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_d3bb3a90d42a3803bfa2520c55d86dc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_d3bb3a90d42a3803bfa2520c55d86dc6.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_aad0f6dc8e135e7c9edeb29d410fbc9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_aad0f6dc8e135e7c9edeb29d410fbc9c.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_3e3b51a355cab8e64a979241cf85d8c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_3e3b51a355cab8e64a979241cf85d8c3.jpg already downloaded
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2d%252F6e2da1d5fc30eb60c879c8ea46f1e4e9%252Fpa%252FEP00364_fe1c89b6948691d237f7a31e7040fb14.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_fe1c89b6948691d237f7a31e7040fb14.jpg already downloaded
2026-03-28 20:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 906e976f-cfb4-5d17-8a93-23a374ca7175, identifier: EP00364
2026-03-28 20:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364
2026-03-28 20:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364
2026-03-28 20:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 906e976f-cfb4-5d17-8a93-23a374ca7175 with identifier: EP00364 to the API
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP00364>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:56:35Z',
 'fuel_type': 'diesel',
 'id': '906e976f-cfb4-5d17-8a93-23a374ca7175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP00364',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 113451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_5da2352db6def0d3a1662f60c959e526.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_e28cb6a6f8d969ef1d6a7690940fb93f.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_bb8f76f4a74cd0fe26901f0003dc475b.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_9e47cb02faf1c03ea1784bc534e38134.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_d2052e9b2a3a7c9ef8ee046d4db3d5b9.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_c95eb5f6cbd240a83cca8ecc91c2da45.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_d3bb3a90d42a3803bfa2520c55d86dc6.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_aad0f6dc8e135e7c9edeb29d410fbc9c.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_3e3b51a355cab8e64a979241cf85d8c3.jpg',
                'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_fe1c89b6948691d237f7a31e7040fb14.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_5da2352db6def0d3a1662f60c959e526.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2255413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_e28cb6a6f8d969ef1d6a7690940fb93f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_bb8f76f4a74cd0fe26901f0003dc475b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_9e47cb02faf1c03ea1784bc534e38134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_d2052e9b2a3a7c9ef8ee046d4db3d5b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_c95eb5f6cbd240a83cca8ecc91c2da45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2068276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_d3bb3a90d42a3803bfa2520c55d86dc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_aad0f6dc8e135e7c9edeb29d410fbc9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_3e3b51a355cab8e64a979241cf85d8c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_906e976f-cfb4-5d17-8a93-23a374ca7175/906e976f-cfb4-5d17-8a93-23a374ca7175_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/2d/6e2da1d5fc30eb60c879c8ea46f1e4e9/pa/EP00364_fe1c89b6948691d237f7a31e7040fb14.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranSport',
 'transmission': 'automatic',
 'trim': 'GranSport',
 'year': 2017}
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [auto1.be] INFO: Saving data for EP00364: {'created_time': 1774730284.801816, 'last_price_update_time': 1774730284.80183, 'auction_closing_time': 1774886195.0}
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP00364') HTTP/1.1" 204 0
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_e8d6d6644a89e44b47652eaba30d2aba.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_d38e8eef951c2814dd72af731682a81e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a81b2f308a888e4da5e7e54c6e018cf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_29cf7335401a7bbc2e610b5697432c3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT63704> (referer: https://www.auto1.com/v1/car-details-view/JT63704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f71750>
2026-03-28 20:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_c8610d9cf685abc9ff55ef4bf91fa618.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_c8610d9cf685abc9ff55ef4bf91fa618.jpg saved to cache
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060
2026-03-28 20:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebf50b4-dc41-581e-b942-9c95e5e59370 with scrape type 1
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_b4dc22bb2d89687d89d33975ac82fddd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_b4dc22bb2d89687d89d33975ac82fddd.jpg not downloaded yet
2026-03-28 20:38:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cb85d0>
2026-03-28 20:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_36d9d43d409ebbf0290e6dde448f64d5.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_36d9d43d409ebbf0290e6dde448f64d5.jpg saved to cache
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030ecc50>
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_e1ee194161d5312f1c889754459ecd93.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_e1ee194161d5312f1c889754459ecd93.jpg saved to cache
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ba67d0>
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_81b9c27779ca849c1a51c1c94d6ab457.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_81b9c27779ca849c1a51c1c94d6ab457.jpg saved to cache
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078
2026-03-28 20:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e with scrape type 1
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_792d7038f9255fa2583f9a89e4451630.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_792d7038f9255fa2583f9a89e4451630.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_36b5026251e5227f03d5f8f13bc074e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_36b5026251e5227f03d5f8f13bc074e3.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_61d350ccddaae168e375f196ff3fd853.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_61d350ccddaae168e375f196ff3fd853.jpg not downloaded yet
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306bcd0>
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_e8d6d6644a89e44b47652eaba30d2aba.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_e8d6d6644a89e44b47652eaba30d2aba.jpg saved to cache
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a3a2d0>
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_d38e8eef951c2814dd72af731682a81e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_d38e8eef951c2814dd72af731682a81e.jpg saved to cache
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803058210>
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_a81b2f308a888e4da5e7e54c6e018cf7.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a81b2f308a888e4da5e7e54c6e018cf7.jpg saved to cache
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1c490>
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_29cf7335401a7bbc2e610b5697432c3e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_29cf7335401a7bbc2e610b5697432c3e.jpg saved to cache
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704
2026-03-28 20:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with scrape type 1
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_5dd3bf55ad85883aa186dcec4cef7e79.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_5dd3bf55ad85883aa186dcec4cef7e79.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_309e8d30b3e9a37c04c91ed89f7c3c65.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_309e8d30b3e9a37c04c91ed89f7c3c65.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_3a5409f5b3fa2b50a4f1e58da1e6a23f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_3a5409f5b3fa2b50a4f1e58da1e6a23f.jpg not downloaded yet
2026-03-28 20:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_d07456c87b50ca02dfe3202ae5d4a707.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_d07456c87b50ca02dfe3202ae5d4a707.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_0acd5cb8935cb31ff93edafb87ecd4dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_0acd5cb8935cb31ff93edafb87ecd4dd.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_45a0f3da3d8fa206a031aa68eb393858.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_45a0f3da3d8fa206a031aa68eb393858.jpg not downloaded yet
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW50956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM81572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_4f92b65208a5dae13af9e945e80bfeca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_4f92b65208a5dae13af9e945e80bfeca.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_abdd60ccbf5ad5d30ee5f9a6ef9e8207.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_abdd60ccbf5ad5d30ee5f9a6ef9e8207.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_16fa529e1cb43b6f8f59cd21df84f783.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_16fa529e1cb43b6f8f59cd21df84f783.jpg not downloaded yet
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_b4dc22bb2d89687d89d33975ac82fddd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_e81fa5994166598cef47da179aca9ed6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e81fa5994166598cef47da179aca9ed6.jpg not downloaded yet
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_36b5026251e5227f03d5f8f13bc074e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_4bc53d78d1532873ca2a79e8ee9bc4af.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_4bc53d78d1532873ca2a79e8ee9bc4af.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_4fe7d62b5f8d1ae61cbafe8e874f3312.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4fe7d62b5f8d1ae61cbafe8e874f3312.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_2a9ac82c123c4f128d7754d4b16dcecf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_2a9ac82c123c4f128d7754d4b16dcecf.jpg not downloaded yet
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_42a1fd31ff0957dd9a40ba0a13926758.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_99e8983afb1b8c64e985bac18df1ca77.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_6d26e440ad0b12dfd9d97c4afce5971a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_ff1a059ce05d40cf1cc8871c8009ed6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_ff1a059ce05d40cf1cc8871c8009ed6f.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_9162e6e328e17e0290749fb0de635e85.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_9162e6e328e17e0290749fb0de635e85.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_6ffd24cc5ea55ef3c8047ec3c9bbb12f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_6ffd24cc5ea55ef3c8047ec3c9bbb12f.jpg not downloaded yet
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_45a0f3da3d8fa206a031aa68eb393858.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_0acd5cb8935cb31ff93edafb87ecd4dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_2ab15a70664649a40c3d52e4c90a828b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_2ab15a70664649a40c3d52e4c90a828b.jpg not downloaded yet
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_d8d5faa435691428726f115b4b4fc438.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_d8d5faa435691428726f115b4b4fc438.jpg not downloaded yet
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_e5966ff46f6003064af7bc38ad73beeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e5966ff46f6003064af7bc38ad73beeb.jpg not downloaded yet
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80315f0d0>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_b4dc22bb2d89687d89d33975ac82fddd.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_b4dc22bb2d89687d89d33975ac82fddd.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a7f0d0>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_36b5026251e5227f03d5f8f13bc074e3.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_36b5026251e5227f03d5f8f13bc074e3.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_70babac005e75b6e906ac26f3e9b1cc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_70babac005e75b6e906ac26f3e9b1cc7.jpg not downloaded yet
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_4a07909e8e5e99b874ac30b92b7a228e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4a07909e8e5e99b874ac30b92b7a228e.jpg not downloaded yet
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_abdd60ccbf5ad5d30ee5f9a6ef9e8207.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_aa430996d8ecff59f61f289f1daf0a45.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_aa430996d8ecff59f61f289f1daf0a45.jpg not downloaded yet
2026-03-28 20:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bf5050>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_42a1fd31ff0957dd9a40ba0a13926758.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_42a1fd31ff0957dd9a40ba0a13926758.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803be75d0>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_99e8983afb1b8c64e985bac18df1ca77.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_99e8983afb1b8c64e985bac18df1ca77.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c87290>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_6d26e440ad0b12dfd9d97c4afce5971a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_6d26e440ad0b12dfd9d97c4afce5971a.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_16fa529e1cb43b6f8f59cd21df84f783.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_135eee9c28be3b735b0dd491b9fae689.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_135eee9c28be3b735b0dd491b9fae689.jpg not downloaded yet
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_b6b164516e80c30fd5c1ae40c01a78a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_b6b164516e80c30fd5c1ae40c01a78a6.jpg not downloaded yet
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_4bc53d78d1532873ca2a79e8ee9bc4af.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4fe7d62b5f8d1ae61cbafe8e874f3312.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_26d182fcc672bf842bf6484381cc4af7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_26d182fcc672bf842bf6484381cc4af7.jpg not downloaded yet
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT53046> (referer: https://www.auto1.com/v1/car-details-view/WT53046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC08569> (referer: https://www.auto1.com/v1/car-details-view/NC08569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802ff01d0>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_45a0f3da3d8fa206a031aa68eb393858.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_45a0f3da3d8fa206a031aa68eb393858.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811fe5d10>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_0acd5cb8935cb31ff93edafb87ecd4dd.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_0acd5cb8935cb31ff93edafb87ecd4dd.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306d290>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_abdd60ccbf5ad5d30ee5f9a6ef9e8207.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_abdd60ccbf5ad5d30ee5f9a6ef9e8207.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_039f1a734e68ec0ad7c39c5e98e2d9c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_039f1a734e68ec0ad7c39c5e98e2d9c8.jpg not downloaded yet
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_6ffd24cc5ea55ef3c8047ec3c9bbb12f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306df50>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_16fa529e1cb43b6f8f59cd21df84f783.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_16fa529e1cb43b6f8f59cd21df84f783.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f24110>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_4bc53d78d1532873ca2a79e8ee9bc4af.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_4bc53d78d1532873ca2a79e8ee9bc4af.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b0e3d0>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_4fe7d62b5f8d1ae61cbafe8e874f3312.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4fe7d62b5f8d1ae61cbafe8e874f3312.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046
2026-03-28 20:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea768c27-2111-53e1-a91e-359a3db3b812 with scrape type 1
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_8167a68fbd574f10d8622b04d1a98536.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8167a68fbd574f10d8622b04d1a98536.jpg not downloaded yet
2026-03-28 20:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569
2026-03-28 20:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e188e062-a9f0-58fa-9f76-49d2a96b9460 with scrape type 1
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_551de4ed8b0defa9ba084a9f55b780a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_551de4ed8b0defa9ba084a9f55b780a3.jpg not downloaded yet
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_9162e6e328e17e0290749fb0de635e85.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4a07909e8e5e99b874ac30b92b7a228e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_b6c8ffd04efd7948e1c2e3ed8acf111e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_b6c8ffd04efd7948e1c2e3ed8acf111e.jpg not downloaded yet
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_bd16d33bd1448193f947a738c5650104.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_bd16d33bd1448193f947a738c5650104.jpg not downloaded yet
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_b6b164516e80c30fd5c1ae40c01a78a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_3dd43be957546064a54551ec6d9dd7a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_3dd43be957546064a54551ec6d9dd7a4.jpg not downloaded yet
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_53a1eff09d844e556d182d2fa53a3b83.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_53a1eff09d844e556d182d2fa53a3b83.jpg not downloaded yet
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031c1090>
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_6ffd24cc5ea55ef3c8047ec3c9bbb12f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_6ffd24cc5ea55ef3c8047ec3c9bbb12f.jpg saved to cache
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a7b9778da1d5fd12c7f88fa8b415a7f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_2e7266846764a0892094d04110e1e987.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2e7266846764a0892094d04110e1e987.jpg not downloaded yet
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_a5cfe6428e417b7c646bf226ef70895b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_a5cfe6428e417b7c646bf226ef70895b.jpg not downloaded yet
2026-03-28 20:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN28044> (referer: https://www.auto1.com/v1/car-details-view/DN28044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:06 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 94 pages/min), scraped 105 items (at 35 items/min)
2026-03-28 20:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-28 20:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_88b106767047111823aa96315172ee9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_88b106767047111823aa96315172ee9c.jpg not downloaded yet
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_95b7827202e148952c59477778b70015.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_95b7827202e148952c59477778b70015.jpg not downloaded yet
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803057dd0>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_9162e6e328e17e0290749fb0de635e85.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_9162e6e328e17e0290749fb0de635e85.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a18f10>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_4a07909e8e5e99b874ac30b92b7a228e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4a07909e8e5e99b874ac30b92b7a228e.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_135eee9c28be3b735b0dd491b9fae689.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_995721d80767eb5f5d8168668abeb997.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_995721d80767eb5f5d8168668abeb997.jpg not downloaded yet
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_4dfee5ff1dda990007d4d9110e20b24f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_4dfee5ff1dda990007d4d9110e20b24f.jpg not downloaded yet
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031d0990>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_b6b164516e80c30fd5c1ae40c01a78a6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_b6b164516e80c30fd5c1ae40c01a78a6.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_26d182fcc672bf842bf6484381cc4af7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_aa430996d8ecff59f61f289f1daf0a45.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_039f1a734e68ec0ad7c39c5e98e2d9c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_d26906e7781628a9fd9b44fc76b4a6a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_d26906e7781628a9fd9b44fc76b4a6a6.jpg not downloaded yet
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_261de271dae824cdd3674c86f1efd4fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_261de271dae824cdd3674c86f1efd4fa.jpg not downloaded yet
2026-03-28 20:38:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030bfb10>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_a7b9778da1d5fd12c7f88fa8b415a7f4.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a7b9778da1d5fd12c7f88fa8b415a7f4.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044
2026-03-28 20:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab18226-1036-599b-8f80-36020af12c19 with scrape type 1
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bab18226-1036-599b-8f80-36020af12c19
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_7e6492560fdb35dab3f880d40ddd7943.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_7e6492560fdb35dab3f880d40ddd7943.jpg not downloaded yet
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030bbc90>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_135eee9c28be3b735b0dd491b9fae689.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_135eee9c28be3b735b0dd491b9fae689.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_8c717bb21a4a338bb1c30d8f1f719168.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8c717bb21a4a338bb1c30d8f1f719168.jpg not downloaded yet
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_7e6f17a29f63abe22317e3abb701f36e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_7e6f17a29f63abe22317e3abb701f36e.jpg not downloaded yet
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8167a68fbd574f10d8622b04d1a98536.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_5abdbc41a0a0bd576410ba2d158e2ce3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_5abdbc41a0a0bd576410ba2d158e2ce3.jpg not downloaded yet
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM81572> (referer: https://www.auto1.com/v1/car-details-view/FM81572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_53a1eff09d844e556d182d2fa53a3b83.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_bd16d33bd1448193f947a738c5650104.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_e5dbd8671d23351e59dd2a18703adcfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_e5dbd8671d23351e59dd2a18703adcfa.jpg not downloaded yet
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_d4d7458518a07701ff03446da1a7025a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_d4d7458518a07701ff03446da1a7025a.jpg not downloaded yet
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030bf3d0>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_26d182fcc672bf842bf6484381cc4af7.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_26d182fcc672bf842bf6484381cc4af7.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803055790>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_aa430996d8ecff59f61f289f1daf0a45.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_aa430996d8ecff59f61f289f1daf0a45.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306cc90>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_039f1a734e68ec0ad7c39c5e98e2d9c8.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_039f1a734e68ec0ad7c39c5e98e2d9c8.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_3dd43be957546064a54551ec6d9dd7a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_6ece2104c81af9ee1a2da3c3ee885b96.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_6ece2104c81af9ee1a2da3c3ee885b96.jpg not downloaded yet
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_61d350ccddaae168e375f196ff3fd853.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_2455f4bacd05e6e8ac9cc7ef9c023bde.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2455f4bacd05e6e8ac9cc7ef9c023bde.jpg not downloaded yet
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_c78cd64bdd14a1740c0abd6f085707a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_c78cd64bdd14a1740c0abd6f085707a4.jpg not downloaded yet
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_792d7038f9255fa2583f9a89e4451630.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_54518c79b8a7ab2bd2020fdc46e72e78.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_54518c79b8a7ab2bd2020fdc46e72e78.jpg not downloaded yet
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80309ccd0>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_8167a68fbd574f10d8622b04d1a98536.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8167a68fbd574f10d8622b04d1a98536.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572
2026-03-28 20:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c with scrape type 1
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_22466db72825cddc542011a0494eb8c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_22466db72825cddc542011a0494eb8c6.jpg not downloaded yet
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802ff0550>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_53a1eff09d844e556d182d2fa53a3b83.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_53a1eff09d844e556d182d2fa53a3b83.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f7ad10>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_bd16d33bd1448193f947a738c5650104.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_bd16d33bd1448193f947a738c5650104.jpg saved to cache
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_88b106767047111823aa96315172ee9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_40f75f5fb8032d580fcaca2f2a6e6ba9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_40f75f5fb8032d580fcaca2f2a6e6ba9.jpg not downloaded yet
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_ae93b091ff07f8e22fef8c19d85fd259.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ae93b091ff07f8e22fef8c19d85fd259.jpg not downloaded yet
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_a5cfe6428e417b7c646bf226ef70895b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_95b7827202e148952c59477778b70015.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_4dfee5ff1dda990007d4d9110e20b24f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80302bb90>
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_3dd43be957546064a54551ec6d9dd7a4.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_3dd43be957546064a54551ec6d9dd7a4.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a7cb90>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_61d350ccddaae168e375f196ff3fd853.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_61d350ccddaae168e375f196ff3fd853.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030a07d0>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_792d7038f9255fa2583f9a89e4451630.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_792d7038f9255fa2583f9a89e4451630.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_193da6d9233ea8989158e7216f731a7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_193da6d9233ea8989158e7216f731a7e.jpg not downloaded yet
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_921fdf13a87f314c03486bb589824ad0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_921fdf13a87f314c03486bb589824ad0.jpg not downloaded yet
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_7e6492560fdb35dab3f880d40ddd7943.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8c717bb21a4a338bb1c30d8f1f719168.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_ea18698415f4483453709e62100abdc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ea18698415f4483453709e62100abdc1.jpg not downloaded yet
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM13926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031bbb10>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_88b106767047111823aa96315172ee9c.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_88b106767047111823aa96315172ee9c.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803aa7010>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_a5cfe6428e417b7c646bf226ef70895b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_a5cfe6428e417b7c646bf226ef70895b.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df4e90>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_95b7827202e148952c59477778b70015.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_95b7827202e148952c59477778b70015.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f79110>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_4dfee5ff1dda990007d4d9110e20b24f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_4dfee5ff1dda990007d4d9110e20b24f.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_19b367b23a8d55b99fec45079f590570.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_19b367b23a8d55b99fec45079f590570.jpg not downloaded yet
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_6ece2104c81af9ee1a2da3c3ee885b96.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_261de271dae824cdd3674c86f1efd4fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_5abdbc41a0a0bd576410ba2d158e2ce3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_dba38b47b2534a2a2cdfd33122cc867b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_dba38b47b2534a2a2cdfd33122cc867b.jpg not downloaded yet
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030aaa90>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_7e6492560fdb35dab3f880d40ddd7943.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_7e6492560fdb35dab3f880d40ddd7943.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bab18226-1036-599b-8f80-36020af12c19
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a128d0>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_8c717bb21a4a338bb1c30d8f1f719168.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8c717bb21a4a338bb1c30d8f1f719168.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_22466db72825cddc542011a0494eb8c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ae93b091ff07f8e22fef8c19d85fd259.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e81fa5994166598cef47da179aca9ed6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bcea50>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_6ece2104c81af9ee1a2da3c3ee885b96.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_6ece2104c81af9ee1a2da3c3ee885b96.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bab18226-1036-599b-8f80-36020af12c19
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b90750>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_261de271dae824cdd3674c86f1efd4fa.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_261de271dae824cdd3674c86f1efd4fa.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a7e390>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_5abdbc41a0a0bd576410ba2d158e2ce3.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_5abdbc41a0a0bd576410ba2d158e2ce3.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bab18226-1036-599b-8f80-36020af12c19
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_d4d7458518a07701ff03446da1a7025a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_40f75f5fb8032d580fcaca2f2a6e6ba9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_921fdf13a87f314c03486bb589824ad0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a0f990>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_22466db72825cddc542011a0494eb8c6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_22466db72825cddc542011a0494eb8c6.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803031110>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_ae93b091ff07f8e22fef8c19d85fd259.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ae93b091ff07f8e22fef8c19d85fd259.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c
2026-03-28 20:38:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031355d0>
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_e81fa5994166598cef47da179aca9ed6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e81fa5994166598cef47da179aca9ed6.jpg saved to cache
2026-03-28 20:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_193da6d9233ea8989158e7216f731a7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ea18698415f4483453709e62100abdc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a19890>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_d4d7458518a07701ff03446da1a7025a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_d4d7458518a07701ff03446da1a7025a.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031d0a90>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_40f75f5fb8032d580fcaca2f2a6e6ba9.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_40f75f5fb8032d580fcaca2f2a6e6ba9.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bab18226-1036-599b-8f80-36020af12c19
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b922d0>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_921fdf13a87f314c03486bb589824ad0.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_921fdf13a87f314c03486bb589824ad0.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2455f4bacd05e6e8ac9cc7ef9c023bde.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_e5dbd8671d23351e59dd2a18703adcfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_dba38b47b2534a2a2cdfd33122cc867b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_19b367b23a8d55b99fec45079f590570.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_54518c79b8a7ab2bd2020fdc46e72e78.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cd0d90>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_193da6d9233ea8989158e7216f731a7e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_193da6d9233ea8989158e7216f731a7e.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bab18226-1036-599b-8f80-36020af12c19
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1ee10>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_ea18698415f4483453709e62100abdc1.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ea18698415f4483453709e62100abdc1.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_d26906e7781628a9fd9b44fc76b4a6a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_995721d80767eb5f5d8168668abeb997.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f7bc90>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_2455f4bacd05e6e8ac9cc7ef9c023bde.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2455f4bacd05e6e8ac9cc7ef9c023bde.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cd0210>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_e5dbd8671d23351e59dd2a18703adcfa.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_e5dbd8671d23351e59dd2a18703adcfa.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2e7266846764a0892094d04110e1e987.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_d8d5faa435691428726f115b4b4fc438.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_b6c8ffd04efd7948e1c2e3ed8acf111e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030ecfd0>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_dba38b47b2534a2a2cdfd33122cc867b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_dba38b47b2534a2a2cdfd33122cc867b.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b521d0>
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F79%252F3279c50550ec6bd8b34aa61c35123751%252Fpa%252FFM81572_19b367b23a8d55b99fec45079f590570.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_19b367b23a8d55b99fec45079f590570.jpg saved to cache
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c
2026-03-28 20:38:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6c68ad6-7c99-59b2-98ae-3d05615ae67c, skipping ID generation
2026-03-28 20:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c with scrape type 1
2026-03-28 20:38:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6c68ad6-7c99-59b2-98ae-3d05615ae67c sending to next pipeline
2026-03-28 20:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6c68ad6-7c99-59b2-98ae-3d05615ae67c, identifier: FM81572
2026-03-28 20:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811dc8f50>
2026-03-28 20:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F05%252Fab056b825975974191e44259db212608%252Fpa%252FDN28044_54518c79b8a7ab2bd2020fdc46e72e78.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_54518c79b8a7ab2bd2020fdc46e72e78.jpg saved to cache
2026-03-28 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bab18226-1036-599b-8f80-36020af12c19
2026-03-28 20:38:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bab18226-1036-599b-8f80-36020af12c19, skipping ID generation
2026-03-28 20:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab18226-1036-599b-8f80-36020af12c19 with scrape type 1
2026-03-28 20:38:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bab18226-1036-599b-8f80-36020af12c19 sending to next pipeline
2026-03-28 20:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bab18226-1036-599b-8f80-36020af12c19, identifier: DN28044
2026-03-28 20:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572
2026-03-28 20:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572
2026-03-28 20:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6c68ad6-7c99-59b2-98ae-3d05615ae67c with identifier: FM81572 to the API
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_19b367b23a8d55b99fec45079f590570.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:23:38Z',
 'fuel_type': 'diesel',
 'id': 'b6c68ad6-7c99-59b2-98ae-3d05615ae67c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM81572',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 116522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_22466db72825cddc542011a0494eb8c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ae93b091ff07f8e22fef8c19d85fd259.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_921fdf13a87f314c03486bb589824ad0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_ea18698415f4483453709e62100abdc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_19b367b23a8d55b99fec45079f590570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6c68ad6-7c99-59b2-98ae-3d05615ae67c/b6c68ad6-7c99-59b2-98ae-3d05615ae67c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/79/3279c50550ec6bd8b34aa61c35123751/pa/FM81572_dba38b47b2534a2a2cdfd33122cc867b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2008}
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-28 20:38:10 [auto1.be] INFO: Saving data for FM81572: {'created_time': 1774730290.605931, 'last_price_update_time': 1774730290.605942, 'auction_closing_time': 1774884218.0}
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM81572') HTTP/1.1" 204 0
2026-03-28 20:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044
2026-03-28 20:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044
2026-03-28 20:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bab18226-1036-599b-8f80-36020af12c19 with identifier: DN28044 to the API
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_54518c79b8a7ab2bd2020fdc46e72e78.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:10Z',
 'fuel_type': 'diesel',
 'id': 'bab18226-1036-599b-8f80-36020af12c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN28044',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 271740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_7e6492560fdb35dab3f880d40ddd7943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_5abdbc41a0a0bd576410ba2d158e2ce3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_6ece2104c81af9ee1a2da3c3ee885b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_54518c79b8a7ab2bd2020fdc46e72e78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_40f75f5fb8032d580fcaca2f2a6e6ba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab18226-1036-599b-8f80-36020af12c19/bab18226-1036-599b-8f80-36020af12c19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/05/ab056b825975974191e44259db212608/pa/DN28044_193da6d9233ea8989158e7216f731a7e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-28 20:38:10 [auto1.be] INFO: Saving data for DN28044: {'created_time': 1774730290.957755, 'last_price_update_time': 1774730290.957767, 'auction_closing_time': 1774886290.0}
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DN28044') HTTP/1.1" 204 0
2026-03-28 20:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_2ab15a70664649a40c3d52e4c90a828b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811f2f310>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_d26906e7781628a9fd9b44fc76b4a6a6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_d26906e7781628a9fd9b44fc76b4a6a6.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df3750>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_995721d80767eb5f5d8168668abeb997.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_995721d80767eb5f5d8168668abeb997.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_ff1a059ce05d40cf1cc8871c8009ed6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_70babac005e75b6e906ac26f3e9b1cc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e5966ff46f6003064af7bc38ad73beeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM13926> (referer: https://www.auto1.com/v1/car-details-view/LM13926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fb6a90>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_2e7266846764a0892094d04110e1e987.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2e7266846764a0892094d04110e1e987.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030a8bd0>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_d8d5faa435691428726f115b4b4fc438.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_d8d5faa435691428726f115b4b4fc438.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031ba110>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F8b%252F3a8bc555af42ddbbe322c85933272edb%252Fpa%252FWT53046_b6c8ffd04efd7948e1c2e3ed8acf111e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_b6c8ffd04efd7948e1c2e3ed8acf111e.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea768c27-2111-53e1-a91e-359a3db3b812
2026-03-28 20:38:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea768c27-2111-53e1-a91e-359a3db3b812, skipping ID generation
2026-03-28 20:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea768c27-2111-53e1-a91e-359a3db3b812 with scrape type 1
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea768c27-2111-53e1-a91e-359a3db3b812 sending to next pipeline
2026-03-28 20:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea768c27-2111-53e1-a91e-359a3db3b812, identifier: WT53046
2026-03-28 20:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046
2026-03-28 20:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046
2026-03-28 20:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea768c27-2111-53e1-a91e-359a3db3b812 with identifier: WT53046 to the API
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_b6c8ffd04efd7948e1c2e3ed8acf111e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'diesel',
 'id': 'ea768c27-2111-53e1-a91e-359a3db3b812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT53046',
 'listing': 'auction',
 'location': 'BE, Rochefort',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 176831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8167a68fbd574f10d8622b04d1a98536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_b6c8ffd04efd7948e1c2e3ed8acf111e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_3dd43be957546064a54551ec6d9dd7a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2e7266846764a0892094d04110e1e987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_88b106767047111823aa96315172ee9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_995721d80767eb5f5d8168668abeb997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_d26906e7781628a9fd9b44fc76b4a6a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_8c717bb21a4a338bb1c30d8f1f719168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_e5dbd8671d23351e59dd2a18703adcfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea768c27-2111-53e1-a91e-359a3db3b812/ea768c27-2111-53e1-a91e-359a3db3b812_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/8b/3a8bc555af42ddbbe322c85933272edb/pa/WT53046_2455f4bacd05e6e8ac9cc7ef9c023bde.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-28 20:38:11 [auto1.be] INFO: Saving data for WT53046: {'created_time': 1774730291.686105, 'last_price_update_time': 1774730291.686117, 'auction_closing_time': 1774886120.0}
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT53046') HTTP/1.1" 204 0
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_4f92b65208a5dae13af9e945e80bfeca.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80302ab90>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_2ab15a70664649a40c3d52e4c90a828b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_2ab15a70664649a40c3d52e4c90a828b.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cd1c90>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_ff1a059ce05d40cf1cc8871c8009ed6f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_ff1a059ce05d40cf1cc8871c8009ed6f.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bdd010>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_70babac005e75b6e906ac26f3e9b1cc7.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_70babac005e75b6e906ac26f3e9b1cc7.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cd1cd0>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_e5966ff46f6003064af7bc38ad73beeb.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e5966ff46f6003064af7bc38ad73beeb.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926
2026-03-28 20:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec with scrape type 1
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_627f2b9af808498113beefba4e5ffd0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_627f2b9af808498113beefba4e5ffd0a.jpg not downloaded yet
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_d07456c87b50ca02dfe3202ae5d4a707.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_309e8d30b3e9a37c04c91ed89f7c3c65.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_3a5409f5b3fa2b50a4f1e58da1e6a23f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_551de4ed8b0defa9ba084a9f55b780a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_2f8f1e058de7e1b0b62991518b74dd1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_2f8f1e058de7e1b0b62991518b74dd1a.jpg not downloaded yet
2026-03-28 20:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW50956> (referer: https://www.auto1.com/v1/car-details-view/MW50956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_7de9589ccdcdcff91ef5c17833b05753.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7de9589ccdcdcff91ef5c17833b05753.jpg not downloaded yet
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803064e90>
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_4f92b65208a5dae13af9e945e80bfeca.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_4f92b65208a5dae13af9e945e80bfeca.jpg saved to cache
2026-03-28 20:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_9107a2d54f11e7c7ae0d8595974cb25c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_9107a2d54f11e7c7ae0d8595974cb25c.jpg not downloaded yet
2026-03-28 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_7e6f17a29f63abe22317e3abb701f36e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_5dd3bf55ad85883aa186dcec4cef7e79.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_422a88a796338eb3666405aa63471b31.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_af6e136d1da513457f0de80a516684fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_af6e136d1da513457f0de80a516684fb.jpg not downloaded yet
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_7f17bb772248758b560e3b77d5ce0235.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7f17bb772248758b560e3b77d5ce0235.jpg not downloaded yet
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b05110>
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_d07456c87b50ca02dfe3202ae5d4a707.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_d07456c87b50ca02dfe3202ae5d4a707.jpg saved to cache
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306d110>
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fff%252Fc0ff72b537045b807077400c5a17f667%252Fpa%252FBC33060_309e8d30b3e9a37c04c91ed89f7c3c65.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_309e8d30b3e9a37c04c91ed89f7c3c65.jpg saved to cache
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ebf50b4-dc41-581e-b942-9c95e5e59370
2026-03-28 20:38:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ebf50b4-dc41-581e-b942-9c95e5e59370, skipping ID generation
2026-03-28 20:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebf50b4-dc41-581e-b942-9c95e5e59370 with scrape type 1
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ebf50b4-dc41-581e-b942-9c95e5e59370 sending to next pipeline
2026-03-28 20:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ebf50b4-dc41-581e-b942-9c95e5e59370, identifier: BC33060
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031b8250>
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fdb%252F67db35ae84b060367a35018a612d7987%252Fpa%252FZW40078_3a5409f5b3fa2b50a4f1e58da1e6a23f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_3a5409f5b3fa2b50a4f1e58da1e6a23f.jpg saved to cache
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e
2026-03-28 20:38:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80e02369-3c33-5065-bd4c-c515e4a1ff8e, skipping ID generation
2026-03-28 20:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e with scrape type 1
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80e02369-3c33-5065-bd4c-c515e4a1ff8e sending to next pipeline
2026-03-28 20:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80e02369-3c33-5065-bd4c-c515e4a1ff8e, identifier: ZW40078
2026-03-28 20:38:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b04d90>
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_551de4ed8b0defa9ba084a9f55b780a3.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_551de4ed8b0defa9ba084a9f55b780a3.jpg saved to cache
2026-03-28 20:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060
2026-03-28 20:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060
2026-03-28 20:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ebf50b4-dc41-581e-b942-9c95e5e59370 with identifier: BC33060 to the API
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_309e8d30b3e9a37c04c91ed89f7c3c65.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 114,
 'expiration_date': '2026-03-30T15:01:24Z',
 'fuel_type': 'petrol',
 'id': '4ebf50b4-dc41-581e-b942-9c95e5e59370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC33060',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 16390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_b4dc22bb2d89687d89d33975ac82fddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_36b5026251e5227f03d5f8f13bc074e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_309e8d30b3e9a37c04c91ed89f7c3c65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_0acd5cb8935cb31ff93edafb87ecd4dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_abdd60ccbf5ad5d30ee5f9a6ef9e8207.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_4bc53d78d1532873ca2a79e8ee9bc4af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_ff1a059ce05d40cf1cc8871c8009ed6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_2ab15a70664649a40c3d52e4c90a828b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_70babac005e75b6e906ac26f3e9b1cc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebf50b4-dc41-581e-b942-9c95e5e59370/4ebf50b4-dc41-581e-b942-9c95e5e59370_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/ff/c0ff72b537045b807077400c5a17f667/pa/BC33060_135eee9c28be3b735b0dd491b9fae689.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-28 20:38:12 [auto1.be] INFO: Saving data for BC33060: {'created_time': 1774730292.911532, 'last_price_update_time': 1774730292.911544, 'auction_closing_time': 1774882884.0}
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC33060') HTTP/1.1" 204 0
2026-03-28 20:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078
2026-03-28 20:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078
2026-03-28 20:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80e02369-3c33-5065-bd4c-c515e4a1ff8e with identifier: ZW40078 to the API
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_3a5409f5b3fa2b50a4f1e58da1e6a23f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:37:31Z',
 'fuel_type': 'diesel',
 'id': '80e02369-3c33-5065-bd4c-c515e4a1ff8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW40078',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 74527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2154917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_792d7038f9255fa2583f9a89e4451630.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2135602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_61d350ccddaae168e375f196ff3fd853.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_3a5409f5b3fa2b50a4f1e58da1e6a23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_45a0f3da3d8fa206a031aa68eb393858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_16fa529e1cb43b6f8f59cd21df84f783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4fe7d62b5f8d1ae61cbafe8e874f3312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_9162e6e328e17e0290749fb0de635e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_d8d5faa435691428726f115b4b4fc438.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_4a07909e8e5e99b874ac30b92b7a228e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80e02369-3c33-5065-bd4c-c515e4a1ff8e/80e02369-3c33-5065-bd4c-c515e4a1ff8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/db/67db35ae84b060367a35018a612d7987/pa/ZW40078_b6b164516e80c30fd5c1ae40c01a78a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-28 20:38:13 [auto1.be] INFO: Saving data for ZW40078: {'created_time': 1774730293.284936, 'last_price_update_time': 1774730293.284949, 'auction_closing_time': 1774885051.0}
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZW40078') HTTP/1.1" 204 0
2026-03-28 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_2dc6795dc37415774a457322801d501d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_b64181a78681c92b2c573b6e962531b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_b64181a78681c92b2c573b6e962531b4.jpg not downloaded yet
2026-03-28 20:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956
2026-03-28 20:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with scrape type 1
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_4a412988af05e23b4bea3ed1cd4fc58f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_4a412988af05e23b4bea3ed1cd4fc58f.jpg not downloaded yet
2026-03-28 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_7869e18e4ed11d8fa6ecdecc3d105dcf.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_a34c73d6758ff0597934d48fcf189d05.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_e0eb869327202272108c720c6fc039fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_c78cd64bdd14a1740c0abd6f085707a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_0c0d2f62e148eb290def94ea7dd6ead2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_0c0d2f62e148eb290def94ea7dd6ead2.jpg not downloaded yet
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_b978f46cedde1d9ae4cd316bea90794a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_b978f46cedde1d9ae4cd316bea90794a.jpg not downloaded yet
2026-03-28 20:38:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f4ab90>
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_7e6f17a29f63abe22317e3abb701f36e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_7e6f17a29f63abe22317e3abb701f36e.jpg saved to cache
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030594d0>
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_5dd3bf55ad85883aa186dcec4cef7e79.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_5dd3bf55ad85883aa186dcec4cef7e79.jpg saved to cache
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f3a0d0>
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F3f%252Fc73f241c5b4dc2257c24fd6ea326939f%252Fpa%252FKZ05274_422a88a796338eb3666405aa63471b31.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_422a88a796338eb3666405aa63471b31.jpg saved to cache
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd
2026-03-28 20:38:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd, skipping ID generation
2026-03-28 20:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with scrape type 1
2026-03-28 20:38:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd sending to next pipeline
2026-03-28 20:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd, identifier: KZ05274
2026-03-28 20:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274
2026-03-28 20:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274
2026-03-28 20:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 33e16a8d-ed0d-5996-8a8a-a8c07cba38fd with identifier: KZ05274 to the API
2026-03-28 20:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_422a88a796338eb3666405aa63471b31.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:54Z',
 'fuel_type': 'diesel',
 'id': '33e16a8d-ed0d-5996-8a8a-a8c07cba38fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ05274',
 'listing': 'auction',
 'location': 'BE, Waver',
 'make': 'Nissan',
 'model': 'Interstar',
 'odometer': 91290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_422a88a796338eb3666405aa63471b31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_42a1fd31ff0957dd9a40ba0a13926758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_99e8983afb1b8c64e985bac18df1ca77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_6d26e440ad0b12dfd9d97c4afce5971a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_81b9c27779ca849c1a51c1c94d6ab457.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2182135,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a7b9778da1d5fd12c7f88fa8b415a7f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_d38e8eef951c2814dd72af731682a81e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_a81b2f308a888e4da5e7e54c6e018cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_e8d6d6644a89e44b47652eaba30d2aba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e16a8d-ed0d-5996-8a8a-a8c07cba38fd/33e16a8d-ed0d-5996-8a8a-a8c07cba38fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/3f/c73f241c5b4dc2257c24fd6ea326939f/pa/KZ05274_29cf7335401a7bbc2e610b5697432c3e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Nissan Interstar 2.3 dCi L3H2 3,5t Acenta FWD',
 'transmission': 'manual',
 'trim': 'L3H2 3,5t Acenta FWD',
 'year': 2022}
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-28 20:38:14 [auto1.be] INFO: Saving data for KZ05274: {'created_time': 1774730294.120405, 'last_price_update_time': 1774730294.120417, 'auction_closing_time': 1774886154.0}
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ05274') HTTP/1.1" 204 0
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_705ae517021dca1d53ae95a4e5008014.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_705ae517021dca1d53ae95a4e5008014.jpg not downloaded yet
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_442a622f773b65bbf0f45d36dadf2b0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_442a622f773b65bbf0f45d36dadf2b0e.jpg not downloaded yet
2026-03-28 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_2f8f1e058de7e1b0b62991518b74dd1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a01d10>
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_2dc6795dc37415774a457322801d501d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_2dc6795dc37415774a457322801d501d.jpg saved to cache
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a24750>
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_7869e18e4ed11d8fa6ecdecc3d105dcf.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_7869e18e4ed11d8fa6ecdecc3d105dcf.jpg saved to cache
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031ddb50>
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F91%252Fdc91e9da2cf1ddc8f772094b21da330f%252Fpa%252FHK87235_a34c73d6758ff0597934d48fcf189d05.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_a34c73d6758ff0597934d48fcf189d05.jpg saved to cache
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3d8eb18-487e-5954-a26d-1588a8718da3
2026-03-28 20:38:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3d8eb18-487e-5954-a26d-1588a8718da3, skipping ID generation
2026-03-28 20:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d8eb18-487e-5954-a26d-1588a8718da3 with scrape type 1
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3d8eb18-487e-5954-a26d-1588a8718da3 sending to next pipeline
2026-03-28 20:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3d8eb18-487e-5954-a26d-1588a8718da3, identifier: HK87235
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030de790>
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_e0eb869327202272108c720c6fc039fe.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_e0eb869327202272108c720c6fc039fe.jpg saved to cache
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:38:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df5750>
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F32%252Fd532e01fdf812be0c11a5e9d7f2ef47a%252Fpa%252FNC08569_c78cd64bdd14a1740c0abd6f085707a4.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_c78cd64bdd14a1740c0abd6f085707a4.jpg saved to cache
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e188e062-a9f0-58fa-9f76-49d2a96b9460
2026-03-28 20:38:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e188e062-a9f0-58fa-9f76-49d2a96b9460, skipping ID generation
2026-03-28 20:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e188e062-a9f0-58fa-9f76-49d2a96b9460 with scrape type 1
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e188e062-a9f0-58fa-9f76-49d2a96b9460 sending to next pipeline
2026-03-28 20:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e188e062-a9f0-58fa-9f76-49d2a96b9460, identifier: NC08569
2026-03-28 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7f17bb772248758b560e3b77d5ce0235.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_9107a2d54f11e7c7ae0d8595974cb25c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_af6e136d1da513457f0de80a516684fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_cfe9b48e62e93585fe6c759990924d2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_cfe9b48e62e93585fe6c759990924d2d.jpg not downloaded yet
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_02fb9a10347867045091e615643c2274.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_02fb9a10347867045091e615643c2274.jpg not downloaded yet
2026-03-28 20:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235
2026-03-28 20:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235
2026-03-28 20:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3d8eb18-487e-5954-a26d-1588a8718da3 with identifier: HK87235 to the API
2026-03-28 20:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_a34c73d6758ff0597934d48fcf189d05.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:57Z',
 'fuel_type': 'diesel',
 'id': 'c3d8eb18-487e-5954-a26d-1588a8718da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK87235',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 164615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_367e046eebd78a86067129d7fe43b72a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_5a0a432fab52f0a1d83cad263c5aee13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552180,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_36d9d43d409ebbf0290e6dde448f64d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_c8610d9cf685abc9ff55ef4bf91fa618.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_ed1849570e20837bc2d8db80fdd25413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2581007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_e1ee194161d5312f1c889754459ecd93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_55e144ee784cf4e0dcad44461c93e41d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_1c66de593d0f9c2a4e19c5a1d9569b68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_a34c73d6758ff0597934d48fcf189d05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d8eb18-487e-5954-a26d-1588a8718da3/c3d8eb18-487e-5954-a26d-1588a8718da3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62786,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/91/dc91e9da2cf1ddc8f772094b21da330f/pa/HK87235_2dc6795dc37415774a457322801d501d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2015}
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [auto1.be] INFO: Saving data for HK87235: {'created_time': 1774730295.111009, 'last_price_update_time': 1774730295.11102, 'auction_closing_time': 1774886337.0}
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK87235') HTTP/1.1" 204 0
2026-03-28 20:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569
2026-03-28 20:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569
2026-03-28 20:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e188e062-a9f0-58fa-9f76-49d2a96b9460 with identifier: NC08569 to the API
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_c78cd64bdd14a1740c0abd6f085707a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:20:43Z',
 'fuel_type': 'diesel',
 'id': 'e188e062-a9f0-58fa-9f76-49d2a96b9460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC08569',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 99884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3693400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_551de4ed8b0defa9ba084a9f55b780a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_bd16d33bd1448193f947a738c5650104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_53a1eff09d844e556d182d2fa53a3b83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_a5cfe6428e417b7c646bf226ef70895b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_95b7827202e148952c59477778b70015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_4dfee5ff1dda990007d4d9110e20b24f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_261de271dae824cdd3674c86f1efd4fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3190623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_7e6f17a29f63abe22317e3abb701f36e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_d4d7458518a07701ff03446da1a7025a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e188e062-a9f0-58fa-9f76-49d2a96b9460/e188e062-a9f0-58fa-9f76-49d2a96b9460_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3090553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/32/d532e01fdf812be0c11a5e9d7f2ef47a/pa/NC08569_c78cd64bdd14a1740c0abd6f085707a4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d Premiere',
 'transmission': 'automatic',
 'trim': 'Premiere',
 'year': 2018}
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [auto1.be] INFO: Saving data for NC08569: {'created_time': 1774730295.474642, 'last_price_update_time': 1774730295.474655, 'auction_closing_time': 1774884043.0}
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC08569') HTTP/1.1" 204 0
2026-03-28 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM52918> (referer: https://www.auto1.com/v1/car-details-view/JM52918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_0a530b65e2eaa837778ac5becaaf4e08.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_107d9be9e924aeb2ef707278a943f9e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_107d9be9e924aeb2ef707278a943f9e6.jpg not downloaded yet
2026-03-28 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR48094> (referer: https://www.auto1.com/v1/car-details-view/DR48094/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803085750>
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_2f8f1e058de7e1b0b62991518b74dd1a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_2f8f1e058de7e1b0b62991518b74dd1a.jpg saved to cache
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_8327f6610f538cb0b42ed1fafd881ca2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_045ad9fbae97956b4cc79cfa6273b45f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_a0e39fcd2f95f5b7a20b502844ed461d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_a0e39fcd2f95f5b7a20b502844ed461d.jpg not downloaded yet
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a31590>
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_7f17bb772248758b560e3b77d5ce0235.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7f17bb772248758b560e3b77d5ce0235.jpg saved to cache
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a94110>
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_9107a2d54f11e7c7ae0d8595974cb25c.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_9107a2d54f11e7c7ae0d8595974cb25c.jpg saved to cache
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c77710>
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_af6e136d1da513457f0de80a516684fb.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_af6e136d1da513457f0de80a516684fb.jpg saved to cache
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_7375ebb795e5057618025326781c1fec.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_7375ebb795e5057618025326781c1fec.jpg not downloaded yet
2026-03-28 20:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_442a622f773b65bbf0f45d36dadf2b0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918
2026-03-28 20:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0a8e239-b960-532c-8eca-7b398758a426 with scrape type 1
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0a8e239-b960-532c-8eca-7b398758a426
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_1142463f78cdb1e54a1c275ed5f4ed0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_1142463f78cdb1e54a1c275ed5f4ed0b.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_7bb4d0bc965a68ccbceae2161c639ec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_7bb4d0bc965a68ccbceae2161c639ec8.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_c4eaece206484281fa3f1b8247a1d6d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_c4eaece206484281fa3f1b8247a1d6d4.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_dc7fe5798e08b2ce2b47173c4e092cab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_dc7fe5798e08b2ce2b47173c4e092cab.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_e26c609db65f0271a6939790992c0a31.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_e26c609db65f0271a6939790992c0a31.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_1487bbfbbb806d1b95e4a69ac9eb2d55.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_1487bbfbbb806d1b95e4a69ac9eb2d55.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_252bc538ba443c28206077673875395a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_252bc538ba443c28206077673875395a.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_b1af5730046f6c2cc595bcae11270921.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_b1af5730046f6c2cc595bcae11270921.jpg already downloaded
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_d596098a739e44bacd342c0c721dce93.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_d596098a739e44bacd342c0c721dce93.jpg already downloaded
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fb1%252F2bb1a16bdf92506fc1855f939ad6b529%252Fpa%252FJM52918_bd201235892ff9ad11539122161e4fbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_bd201235892ff9ad11539122161e4fbd.jpg already downloaded
2026-03-28 20:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0a8e239-b960-532c-8eca-7b398758a426, identifier: JM52918
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fd21d0>
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_0a530b65e2eaa837778ac5becaaf4e08.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_0a530b65e2eaa837778ac5becaaf4e08.jpg saved to cache
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094
2026-03-28 20:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa343cee-1df5-5d21-b139-41ed088a54d3 with scrape type 1
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_83c1d89a1c82311b73e3fbf5698038a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_83c1d89a1c82311b73e3fbf5698038a5.jpg not downloaded yet
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306dad0>
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_8327f6610f538cb0b42ed1fafd881ca2.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_8327f6610f538cb0b42ed1fafd881ca2.jpg saved to cache
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a6e1d0>
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_045ad9fbae97956b4cc79cfa6273b45f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_045ad9fbae97956b4cc79cfa6273b45f.jpg saved to cache
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_705ae517021dca1d53ae95a4e5008014.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_fd2ed5f508fcbd495dfc5fd534295f3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_fd2ed5f508fcbd495dfc5fd534295f3b.jpg not downloaded yet
2026-03-28 20:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918
2026-03-28 20:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918
2026-03-28 20:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0a8e239-b960-532c-8eca-7b398758a426 with identifier: JM52918 to the API
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM52918>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:22Z',
 'fuel_type': 'diesel',
 'id': 'e0a8e239-b960-532c-8eca-7b398758a426',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM52918',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 160718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_1142463f78cdb1e54a1c275ed5f4ed0b.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_7bb4d0bc965a68ccbceae2161c639ec8.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_c4eaece206484281fa3f1b8247a1d6d4.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_dc7fe5798e08b2ce2b47173c4e092cab.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_e26c609db65f0271a6939790992c0a31.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_1487bbfbbb806d1b95e4a69ac9eb2d55.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_252bc538ba443c28206077673875395a.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_b1af5730046f6c2cc595bcae11270921.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_d596098a739e44bacd342c0c721dce93.jpg',
                'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_bd201235892ff9ad11539122161e4fbd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2220939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_1142463f78cdb1e54a1c275ed5f4ed0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2310218,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_7bb4d0bc965a68ccbceae2161c639ec8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_c4eaece206484281fa3f1b8247a1d6d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2058011,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_dc7fe5798e08b2ce2b47173c4e092cab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_e26c609db65f0271a6939790992c0a31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_1487bbfbbb806d1b95e4a69ac9eb2d55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_252bc538ba443c28206077673875395a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_b1af5730046f6c2cc595bcae11270921.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_d596098a739e44bacd342c0c721dce93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a8e239-b960-532c-8eca-7b398758a426/e0a8e239-b960-532c-8eca-7b398758a426_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/b1/2bb1a16bdf92506fc1855f939ad6b529/pa/JM52918_bd201235892ff9ad11539122161e4fbd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [auto1.be] INFO: Saving data for JM52918: {'created_time': 1774730296.618869, 'last_price_update_time': 1774730296.618882, 'auction_closing_time': 1774884982.0}
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM52918') HTTP/1.1" 204 0
2026-03-28 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_b978f46cedde1d9ae4cd316bea90794a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_714a24de629a3de75535eba2b9f69040.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_714a24de629a3de75535eba2b9f69040.jpg not downloaded yet
2026-03-28 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_0c0d2f62e148eb290def94ea7dd6ead2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_ba94bef8a1479923c5c14fd44f789a2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ba94bef8a1479923c5c14fd44f789a2c.jpg not downloaded yet
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030a5990>
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_442a622f773b65bbf0f45d36dadf2b0e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_442a622f773b65bbf0f45d36dadf2b0e.jpg saved to cache
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_4a412988af05e23b4bea3ed1cd4fc58f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_a23f65b4026cf2012647946056096ffe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_a23f65b4026cf2012647946056096ffe.jpg not downloaded yet
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_ce18022de8bcdf7c9a24aadcdab46bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ce18022de8bcdf7c9a24aadcdab46bca.jpg not downloaded yet
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fae9d0>
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_705ae517021dca1d53ae95a4e5008014.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_705ae517021dca1d53ae95a4e5008014.jpg saved to cache
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_def78977177402240e5ac7d6c979424d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_def78977177402240e5ac7d6c979424d.jpg not downloaded yet
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_b961f7225f72bff647ec6ee2168b87f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_b961f7225f72bff647ec6ee2168b87f3.jpg not downloaded yet
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803095b90>
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_b978f46cedde1d9ae4cd316bea90794a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_b978f46cedde1d9ae4cd316bea90794a.jpg saved to cache
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b00fd0>
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_0c0d2f62e148eb290def94ea7dd6ead2.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_0c0d2f62e148eb290def94ea7dd6ead2.jpg saved to cache
2026-03-28 20:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_02fb9a10347867045091e615643c2274.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_cfe9b48e62e93585fe6c759990924d2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_b64181a78681c92b2c573b6e962531b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_f632171aec42b9d854e08621915c49e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_f632171aec42b9d854e08621915c49e7.jpg not downloaded yet
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b94fd0>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_4a412988af05e23b4bea3ed1cd4fc58f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_4a412988af05e23b4bea3ed1cd4fc58f.jpg saved to cache
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_107d9be9e924aeb2ef707278a943f9e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_2a9ac82c123c4f128d7754d4b16dcecf.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_af768f645a53d5b50cea88dc26e602f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_8f021f86472106b0244895fa02288a60.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_8f021f86472106b0244895fa02288a60.jpg not downloaded yet
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_7c06cd618ccf9d5f1334337d03c5adb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7c06cd618ccf9d5f1334337d03c5adb4.jpg not downloaded yet
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_15c8f650912204ece7bb29e5f72a45e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_15c8f650912204ece7bb29e5f72a45e6.jpg not downloaded yet
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_7b11c9adf2aeee326b627093871d4605.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7b11c9adf2aeee326b627093871d4605.jpg not downloaded yet
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c5f250>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_02fb9a10347867045091e615643c2274.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_02fb9a10347867045091e615643c2274.jpg saved to cache
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bb6410>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_cfe9b48e62e93585fe6c759990924d2d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_cfe9b48e62e93585fe6c759990924d2d.jpg saved to cache
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030b3050>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_b64181a78681c92b2c573b6e962531b4.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_b64181a78681c92b2c573b6e962531b4.jpg saved to cache
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_714a24de629a3de75535eba2b9f69040.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_7375ebb795e5057618025326781c1fec.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_a0e39fcd2f95f5b7a20b502844ed461d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_fd2ed5f508fcbd495dfc5fd534295f3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a0a350>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_107d9be9e924aeb2ef707278a943f9e6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_107d9be9e924aeb2ef707278a943f9e6.jpg saved to cache
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811dfaf50>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F48%252F0d4875e00a69c6a84e8c0805ef56dd67%252Fpa%252FJT63704_2a9ac82c123c4f128d7754d4b16dcecf.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_2a9ac82c123c4f128d7754d4b16dcecf.jpg saved to cache
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b
2026-03-28 20:38:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b, skipping ID generation
2026-03-28 20:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with scrape type 1
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b sending to next pipeline
2026-03-28 20:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b, identifier: JT63704
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811defe10>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_af768f645a53d5b50cea88dc26e602f6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_af768f645a53d5b50cea88dc26e602f6.jpg saved to cache
2026-03-28 20:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704
2026-03-28 20:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704
2026-03-28 20:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6a9fcc85-b0a3-5ce0-a531-54171e2ed35b with identifier: JT63704 to the API
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_2a9ac82c123c4f128d7754d4b16dcecf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:14Z',
 'fuel_type': 'petrol',
 'id': '6a9fcc85-b0a3-5ce0-a531-54171e2ed35b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT63704',
 'listing': 'auction',
 'location': 'BE, Aarschot',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 166950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_5dd3bf55ad85883aa186dcec4cef7e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_d07456c87b50ca02dfe3202ae5d4a707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_4f92b65208a5dae13af9e945e80bfeca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2488711,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e81fa5994166598cef47da179aca9ed6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727785,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_2a9ac82c123c4f128d7754d4b16dcecf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_6ffd24cc5ea55ef3c8047ec3c9bbb12f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_e5966ff46f6003064af7bc38ad73beeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_aa430996d8ecff59f61f289f1daf0a45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_26d182fcc672bf842bf6484381cc4af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a9fcc85-b0a3-5ce0-a531-54171e2ed35b/6a9fcc85-b0a3-5ce0-a531-54171e2ed35b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/48/0d4875e00a69c6a84e8c0805ef56dd67/pa/JT63704_039f1a734e68ec0ad7c39c5e98e2d9c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2017}
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-28 20:38:17 [auto1.be] INFO: Saving data for JT63704: {'created_time': 1774730297.885569, 'last_price_update_time': 1774730297.885579, 'auction_closing_time': 1774884614.0}
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT63704') HTTP/1.1" 204 0
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_627f2b9af808498113beefba4e5ffd0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_def78977177402240e5ac7d6c979424d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_b961f7225f72bff647ec6ee2168b87f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_a23f65b4026cf2012647946056096ffe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ce18022de8bcdf7c9a24aadcdab46bca.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b524d0>
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_714a24de629a3de75535eba2b9f69040.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_714a24de629a3de75535eba2b9f69040.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a96150>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_7375ebb795e5057618025326781c1fec.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_7375ebb795e5057618025326781c1fec.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a1f990>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_a0e39fcd2f95f5b7a20b502844ed461d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_a0e39fcd2f95f5b7a20b502844ed461d.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811af9850>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_fd2ed5f508fcbd495dfc5fd534295f3b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_fd2ed5f508fcbd495dfc5fd534295f3b.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7b11c9adf2aeee326b627093871d4605.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_f632171aec42b9d854e08621915c49e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ba94bef8a1479923c5c14fd44f789a2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7de9589ccdcdcff91ef5c17833b05753.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80312d150>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_627f2b9af808498113beefba4e5ffd0a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_627f2b9af808498113beefba4e5ffd0a.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803089690>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_def78977177402240e5ac7d6c979424d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_def78977177402240e5ac7d6c979424d.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f36a90>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_b961f7225f72bff647ec6ee2168b87f3.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_b961f7225f72bff647ec6ee2168b87f3.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80302b810>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_a23f65b4026cf2012647946056096ffe.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_a23f65b4026cf2012647946056096ffe.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce3b90>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_ce18022de8bcdf7c9a24aadcdab46bca.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ce18022de8bcdf7c9a24aadcdab46bca.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_15c8f650912204ece7bb29e5f72a45e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_8f021f86472106b0244895fa02288a60.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7c06cd618ccf9d5f1334337d03c5adb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_5f2aadf0175f0caed2a19a4c508a2cda.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c77e10>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_7b11c9adf2aeee326b627093871d4605.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7b11c9adf2aeee326b627093871d4605.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b1ba10>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_f632171aec42b9d854e08621915c49e7.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_f632171aec42b9d854e08621915c49e7.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80306e110>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fba%252F16ba4b674f0214bbd1aafd3f2def0f6a%252Fpa%252FMW50956_ba94bef8a1479923c5c14fd44f789a2c.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ba94bef8a1479923c5c14fd44f789a2c.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342
2026-03-28 20:38:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 933c4ebd-e39a-55f7-8abd-7b2ee3936342, skipping ID generation
2026-03-28 20:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with scrape type 1
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 933c4ebd-e39a-55f7-8abd-7b2ee3936342 sending to next pipeline
2026-03-28 20:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 933c4ebd-e39a-55f7-8abd-7b2ee3936342, identifier: MW50956
2026-03-28 20:38:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b2e610>
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2d%252Fa72de0eee86f7c022640475f75fcc9e3%252Fpa%252FLM13926_7de9589ccdcdcff91ef5c17833b05753.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7de9589ccdcdcff91ef5c17833b05753.jpg saved to cache
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec
2026-03-28 20:38:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18907c7b-024a-5777-a8e1-8a4ea18d99ec, skipping ID generation
2026-03-28 20:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec with scrape type 1
2026-03-28 20:38:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18907c7b-024a-5777-a8e1-8a4ea18d99ec sending to next pipeline
2026-03-28 20:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18907c7b-024a-5777-a8e1-8a4ea18d99ec, identifier: LM13926
2026-03-28 20:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956
2026-03-28 20:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956
2026-03-28 20:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 933c4ebd-e39a-55f7-8abd-7b2ee3936342 with identifier: MW50956 to the API
2026-03-28 20:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ba94bef8a1479923c5c14fd44f789a2c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.9L',
 'engine_horse_power': 462,
 'expiration_date': '2026-03-30T15:52:29Z',
 'fuel_type': 'hybrid',
 'id': '933c4ebd-e39a-55f7-8abd-7b2ee3936342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW50956',
 'listing': 'auction',
 'location': 'BE, Waver',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 240915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_4a412988af05e23b4bea3ed1cd4fc58f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_b978f46cedde1d9ae4cd316bea90794a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_442a622f773b65bbf0f45d36dadf2b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_02fb9a10347867045091e615643c2274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_107d9be9e924aeb2ef707278a943f9e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_a0e39fcd2f95f5b7a20b502844ed461d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_7375ebb795e5057618025326781c1fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_fd2ed5f508fcbd495dfc5fd534295f3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ba94bef8a1479923c5c14fd44f789a2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_933c4ebd-e39a-55f7-8abd-7b2ee3936342/933c4ebd-e39a-55f7-8abd-7b2ee3936342_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/ba/16ba4b674f0214bbd1aafd3f2def0f6a/pa/MW50956_ce18022de8bcdf7c9a24aadcdab46bca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche Panamera 4 E-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-28 20:38:19 [auto1.be] INFO: Saving data for MW50956: {'created_time': 1774730299.207849, 'last_price_update_time': 1774730299.207865, 'auction_closing_time': 1774885949.0}
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MW50956') HTTP/1.1" 204 0
2026-03-28 20:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926
2026-03-28 20:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926
2026-03-28 20:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18907c7b-024a-5777-a8e1-8a4ea18d99ec with identifier: LM13926 to the API
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7de9589ccdcdcff91ef5c17833b05753.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:49Z',
 'fuel_type': 'petrol',
 'id': '18907c7b-024a-5777-a8e1-8a4ea18d99ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM13926',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 166420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550761,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_627f2b9af808498113beefba4e5ffd0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_2f8f1e058de7e1b0b62991518b74dd1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2581788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7de9589ccdcdcff91ef5c17833b05753.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_9107a2d54f11e7c7ae0d8595974cb25c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_af6e136d1da513457f0de80a516684fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_7f17bb772248758b560e3b77d5ce0235.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_b64181a78681c92b2c573b6e962531b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_0c0d2f62e148eb290def94ea7dd6ead2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_705ae517021dca1d53ae95a4e5008014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18907c7b-024a-5777-a8e1-8a4ea18d99ec/18907c7b-024a-5777-a8e1-8a4ea18d99ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2d/a72de0eee86f7c022640475f75fcc9e3/pa/LM13926_cfe9b48e62e93585fe6c759990924d2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2013}
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-28 20:38:19 [auto1.be] INFO: Saving data for LM13926: {'created_time': 1774730299.587134, 'last_price_update_time': 1774730299.587149, 'auction_closing_time': 1774883329.0}
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM13926') HTTP/1.1" 204 0
2026-03-28 20:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_3297601c307cfa638810c9fe6b85479f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_941be155b48daab5cbbb6b0adda66327.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030966d0>
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_15c8f650912204ece7bb29e5f72a45e6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_15c8f650912204ece7bb29e5f72a45e6.jpg saved to cache
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fafc50>
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_8f021f86472106b0244895fa02288a60.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_8f021f86472106b0244895fa02288a60.jpg saved to cache
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b93b10>
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_7c06cd618ccf9d5f1334337d03c5adb4.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7c06cd618ccf9d5f1334337d03c5adb4.jpg saved to cache
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a6dc90>
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_5f2aadf0175f0caed2a19a4c508a2cda.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_5f2aadf0175f0caed2a19a4c508a2cda.jpg saved to cache
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4267a88c77dcab48f1e9b4544d7b5d21.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cca0d0>
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_3297601c307cfa638810c9fe6b85479f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_3297601c307cfa638810c9fe6b85479f.jpg saved to cache
2026-03-28 20:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f091d0>
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F59%252Fcd597f6430ce6edb3111f4a8113450e3%252Fpa%252FHS15781_941be155b48daab5cbbb6b0adda66327.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_941be155b48daab5cbbb6b0adda66327.jpg saved to cache
2026-03-28 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79b2552a-3753-5935-b5aa-78022f00079d
2026-03-28 20:38:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79b2552a-3753-5935-b5aa-78022f00079d, skipping ID generation
2026-03-28 20:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b2552a-3753-5935-b5aa-78022f00079d with scrape type 1
2026-03-28 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79b2552a-3753-5935-b5aa-78022f00079d sending to next pipeline
2026-03-28 20:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79b2552a-3753-5935-b5aa-78022f00079d, identifier: HS15781
2026-03-28 20:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781
2026-03-28 20:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781
2026-03-28 20:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79b2552a-3753-5935-b5aa-78022f00079d with identifier: HS15781 to the API
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_941be155b48daab5cbbb6b0adda66327.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:33:40Z',
 'fuel_type': 'diesel',
 'id': '79b2552a-3753-5935-b5aa-78022f00079d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS15781',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 126668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_7d63cc81945ece8eb4b5987b34040713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_e0eb869327202272108c720c6fc039fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_776b579386013ae80fb4c012327f6d31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_930314ca0b929890fd1ef2222a86baa5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_9f93308d0014943eb709c97a3422814c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f8e6b545850e18d145727b2fc8f66365.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_0f203b45c33e213d9f94649990bb25e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_833e320c41a17353ce587a1e152ee41c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3711758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_941be155b48daab5cbbb6b0adda66327.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b2552a-3753-5935-b5aa-78022f00079d/79b2552a-3753-5935-b5aa-78022f00079d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/59/cd597f6430ce6edb3111f4a8113450e3/pa/HS15781_f9fc56753735728503dc4a30d0a8b0ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-28 20:38:20 [auto1.be] INFO: Saving data for HS15781: {'created_time': 1774730300.533669, 'last_price_update_time': 1774730300.533682, 'auction_closing_time': 1774884820.0}
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS15781') HTTP/1.1" 204 0
2026-03-28 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT80629> (referer: https://www.auto1.com/v1/car-details-view/HT80629/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF49476> (referer: https://www.auto1.com/v1/car-details-view/TF49476/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY75694> (referer: https://www.auto1.com/v1/car-details-view/MY75694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC19794> (referer: https://www.auto1.com/v1/car-details-view/WC19794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW17867> (referer: https://www.auto1.com/v1/car-details-view/KW17867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX16585> (referer: https://www.auto1.com/v1/car-details-view/SX16585/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803136f90>
2026-03-28 20:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fa0%252F08a0af9f8349a27848058a6569cfb665%252Fpa%252FRD23593_4267a88c77dcab48f1e9b4544d7b5d21.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4267a88c77dcab48f1e9b4544d7b5d21.jpg saved to cache
2026-03-28 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e
2026-03-28 20:38:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25613ed9-f9eb-56cd-9ec2-511ffca8132e, skipping ID generation
2026-03-28 20:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e with scrape type 1
2026-03-28 20:38:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25613ed9-f9eb-56cd-9ec2-511ffca8132e sending to next pipeline
2026-03-28 20:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25613ed9-f9eb-56cd-9ec2-511ffca8132e, identifier: RD23593
2026-03-28 20:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593
2026-03-28 20:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593
2026-03-28 20:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25613ed9-f9eb-56cd-9ec2-511ffca8132e with identifier: RD23593 to the API
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4267a88c77dcab48f1e9b4544d7b5d21.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:53:16Z',
 'fuel_type': 'diesel',
 'id': '25613ed9-f9eb-56cd-9ec2-511ffca8132e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD23593',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 170232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344349,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4267a88c77dcab48f1e9b4544d7b5d21.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_5f2aadf0175f0caed2a19a4c508a2cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323921,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_3297601c307cfa638810c9fe6b85479f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_af768f645a53d5b50cea88dc26e602f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_045ad9fbae97956b4cc79cfa6273b45f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_8327f6610f538cb0b42ed1fafd881ca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_0a530b65e2eaa837778ac5becaaf4e08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_7869e18e4ed11d8fa6ecdecc3d105dcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4184dde84e025d2e1f35fef030716d6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25613ed9-f9eb-56cd-9ec2-511ffca8132e/25613ed9-f9eb-56cd-9ec2-511ffca8132e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/a0/08a0af9f8349a27848058a6569cfb665/pa/RD23593_4ec3a04e8bb1350811d13382eaf7e12d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 Escapade',
 'transmission': 'manual',
 'trim': 'L2H1 Escapade',
 'year': 2021}
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [auto1.be] INFO: Saving data for RD23593: {'created_time': 1774730301.11669, 'last_price_update_time': 1774730301.116704, 'auction_closing_time': 1774885996.0}
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD23593') HTTP/1.1" 204 0
2026-03-28 20:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629
2026-03-28 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with scrape type 1
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_3b2bbe5466ea3635cfa080da29c5b21b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_3b2bbe5466ea3635cfa080da29c5b21b.jpg not downloaded yet
2026-03-28 20:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476
2026-03-28 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22baa273-e520-5500-a7b4-d64af948f4c5 with scrape type 1
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_a2d779c5d16eb0c46f5a53cc1cf6c88b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_a2d779c5d16eb0c46f5a53cc1cf6c88b.jpg not downloaded yet
2026-03-28 20:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694
2026-03-28 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96362a5-b7df-5360-9b83-8295d9f087d0 with scrape type 1
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e96362a5-b7df-5360-9b83-8295d9f087d0
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_0a27bb244b309075ec2c5cd2d7e1902a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_0a27bb244b309075ec2c5cd2d7e1902a.jpg not downloaded yet
2026-03-28 20:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794
2026-03-28 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c904cb93-d0db-589e-806e-6cd84b372f27 with scrape type 1
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_a1f5f4bff34f01ff1a4cf2e8d81c5b7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_a1f5f4bff34f01ff1a4cf2e8d81c5b7e.jpg not downloaded yet
2026-03-28 20:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867
2026-03-28 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b82520-6582-5f7a-9216-1dec75494356 with scrape type 1
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_bd2c5f8526a292966604bdef61786930.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_bd2c5f8526a292966604bdef61786930.jpg not downloaded yet
2026-03-28 20:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585
2026-03-28 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with scrape type 1
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_7c68ad47c116ebe95b906663b3f5c461.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c68ad47c116ebe95b906663b3f5c461.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_91be0ca67be46311b943b0fd3ddc5523.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_91be0ca67be46311b943b0fd3ddc5523.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_10df7f2e5db217af6acac0f573264c92.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_10df7f2e5db217af6acac0f573264c92.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_e8060d33ecaf9da18dc96c15a0c316bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e8060d33ecaf9da18dc96c15a0c316bd.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_4d2d7376b77c3bd6d39c46dc302cf8ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_4d2d7376b77c3bd6d39c46dc302cf8ee.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_e69f18e338cb2fcd3e1ceb831ba258a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_e69f18e338cb2fcd3e1ceb831ba258a0.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_90b9f43f937bd0afafb4d764ead82e60.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_90b9f43f937bd0afafb4d764ead82e60.jpg not downloaded yet
2026-03-28 20:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_83c1d89a1c82311b73e3fbf5698038a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_e4b16cd1feaab8bb673202428ccbb5ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_e4b16cd1feaab8bb673202428ccbb5ab.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_e05cd659ab6b498790169883db20dba1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_e05cd659ab6b498790169883db20dba1.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_e39d2ed55e61f75eb55bf4d8060d8fdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e39d2ed55e61f75eb55bf4d8060d8fdd.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_3f9c59125bcea8f5955aebc61b7d3ecf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_3f9c59125bcea8f5955aebc61b7d3ecf.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_22607338f05f60bf2d8de378ed529dca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_22607338f05f60bf2d8de378ed529dca.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_42be3e50ce5140bb5cdde89f51cb37e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_42be3e50ce5140bb5cdde89f51cb37e8.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_8814781f62745897724c4223f0d87145.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_8814781f62745897724c4223f0d87145.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_0402b0462cfcad60013f57ff2cec39a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_0402b0462cfcad60013f57ff2cec39a9.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_2501162210da2464e81f44cc623d92ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_2501162210da2464e81f44cc623d92ca.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_fa695ec2f49c3fa33c953334bc7135ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa695ec2f49c3fa33c953334bc7135ba.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_1ca605dac51a28dd3617b816697f101f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_1ca605dac51a28dd3617b816697f101f.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_8b4ba21ce02b877c1783ec8e590a97c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8b4ba21ce02b877c1783ec8e590a97c0.jpg not downloaded yet
2026-03-28 20:38:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031c9610>
2026-03-28 20:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fa7%252F05a746ed693bbcfdb2c096c5c4e6ac63%252Fpa%252FDR48094_83c1d89a1c82311b73e3fbf5698038a5.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_83c1d89a1c82311b73e3fbf5698038a5.jpg saved to cache
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa343cee-1df5-5d21-b139-41ed088a54d3
2026-03-28 20:38:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa343cee-1df5-5d21-b139-41ed088a54d3, skipping ID generation
2026-03-28 20:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa343cee-1df5-5d21-b139-41ed088a54d3 with scrape type 1
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa343cee-1df5-5d21-b139-41ed088a54d3 sending to next pipeline
2026-03-28 20:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa343cee-1df5-5d21-b139-41ed088a54d3, identifier: DR48094
2026-03-28 20:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c68ad47c116ebe95b906663b3f5c461.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_634af0431ba231cc9fae6a4fcef94440.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_634af0431ba231cc9fae6a4fcef94440.jpg not downloaded yet
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_d80b995d8e5be9dd5eb62d1a2993be85.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_d80b995d8e5be9dd5eb62d1a2993be85.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_08bc728d01e3e1c7eff76f13d995f2d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_08bc728d01e3e1c7eff76f13d995f2d3.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_fa8360ea02b52e604337178001dd0a85.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa8360ea02b52e604337178001dd0a85.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_258f22214b5cd3b84e5134c93b7b3f6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_258f22214b5cd3b84e5134c93b7b3f6e.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_8f25fb444ba81904f0e4af3dfa81ad21.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8f25fb444ba81904f0e4af3dfa81ad21.jpg not downloaded yet
2026-03-28 20:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094
2026-03-28 20:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094
2026-03-28 20:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa343cee-1df5-5d21-b139-41ed088a54d3 with identifier: DR48094 to the API
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_83c1d89a1c82311b73e3fbf5698038a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:41:41Z',
 'fuel_type': 'petrol',
 'id': 'fa343cee-1df5-5d21-b139-41ed088a54d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR48094',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 112679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2559055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_83c1d89a1c82311b73e3fbf5698038a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_714a24de629a3de75535eba2b9f69040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_a23f65b4026cf2012647946056096ffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_def78977177402240e5ac7d6c979424d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_b961f7225f72bff647ec6ee2168b87f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_f632171aec42b9d854e08621915c49e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_8f021f86472106b0244895fa02288a60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7c06cd618ccf9d5f1334337d03c5adb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_15c8f650912204ece7bb29e5f72a45e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa343cee-1df5-5d21-b139-41ed088a54d3/fa343cee-1df5-5d21-b139-41ed088a54d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/a7/05a746ed693bbcfdb2c096c5c4e6ac63/pa/DR48094_7b11c9adf2aeee326b627093871d4605.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2014}
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [auto1.be] INFO: Saving data for DR48094: {'created_time': 1774730302.462637, 'last_price_update_time': 1774730302.462652, 'auction_closing_time': 1774885301.0}
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DR48094') HTTP/1.1" 204 0
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_a1f5f4bff34f01ff1a4cf2e8d81c5b7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_0a27bb244b309075ec2c5cd2d7e1902a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_bd2c5f8526a292966604bdef61786930.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_90b9f43f937bd0afafb4d764ead82e60.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_1a5eb36b2986ee26cb628389b6630d14.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_1a5eb36b2986ee26cb628389b6630d14.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_6e768c9d6af521a7a88042e6038f1006.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6e768c9d6af521a7a88042e6038f1006.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_1a812747e94b052e9a7ce64d4285c4d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_1a812747e94b052e9a7ce64d4285c4d2.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_27d6b8a1da010e96d7b0f31e0161758c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_27d6b8a1da010e96d7b0f31e0161758c.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_8b39e25cf502a48c62156a870f732996.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_8b39e25cf502a48c62156a870f732996.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_2c5a7d8e81a1ab262f7cd49d8b598c3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_2c5a7d8e81a1ab262f7cd49d8b598c3f.jpg not downloaded yet
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US61524/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ93890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN00999/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ76034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV93759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG99308> (referer: https://www.auto1.com/v1/car-details-view/LG99308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_4b8f011bd50e87259b4d4f9f6a5c8210.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_4b8f011bd50e87259b4d4f9f6a5c8210.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_6214dce6907b4951e3e5c68470c249d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6214dce6907b4951e3e5c68470c249d9.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_76ea0bdf7589f944e0169a774ce3ea04.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_76ea0bdf7589f944e0169a774ce3ea04.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_cdfca0b36dc905bf1d249d9858dfeef3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_cdfca0b36dc905bf1d249d9858dfeef3.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_54ee027314057cd8ef86c63eeda422a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_54ee027314057cd8ef86c63eeda422a9.jpg not downloaded yet
2026-03-28 20:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a10190>
2026-03-28 20:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_7c68ad47c116ebe95b906663b3f5c461.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c68ad47c116ebe95b906663b3f5c461.jpg saved to cache
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa695ec2f49c3fa33c953334bc7135ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8b4ba21ce02b877c1783ec8e590a97c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_bc4ede9f160e350fa19f25fc1632e80f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_bc4ede9f160e350fa19f25fc1632e80f.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_c014426572cb367ac8cb4c6a9010d300.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_c014426572cb367ac8cb4c6a9010d300.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_81571b6ef0f6669ea33b33ae467d3436.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_81571b6ef0f6669ea33b33ae467d3436.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_0728556a1f560250690251b91d71696d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_0728556a1f560250690251b91d71696d.jpg not downloaded yet
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_7c37d4d74e400f16067f9f41779bc773.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c37d4d74e400f16067f9f41779bc773.jpg not downloaded yet
2026-03-28 20:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_2501162210da2464e81f44cc623d92ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bdc2d0>
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_a1f5f4bff34f01ff1a4cf2e8d81c5b7e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_a1f5f4bff34f01ff1a4cf2e8d81c5b7e.jpg saved to cache
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802ed19d0>
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_0a27bb244b309075ec2c5cd2d7e1902a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_0a27bb244b309075ec2c5cd2d7e1902a.jpg saved to cache
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e96362a5-b7df-5360-9b83-8295d9f087d0
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802ee6410>
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_bd2c5f8526a292966604bdef61786930.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_bd2c5f8526a292966604bdef61786930.jpg saved to cache
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802ee7e10>
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_90b9f43f937bd0afafb4d764ead82e60.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_90b9f43f937bd0afafb4d764ead82e60.jpg saved to cache
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308
2026-03-28 20:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c616886c-40cd-54e2-876c-ca245eae83f0 with scrape type 1
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c616886c-40cd-54e2-876c-ca245eae83f0
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_fd52e69d4d9b91a16ec960c83b90780f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_fd52e69d4d9b91a16ec960c83b90780f.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_95257dceb251d795e455e26d96cdc776.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_95257dceb251d795e455e26d96cdc776.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_ad41c998638b0451fed7ad3e46cdad83.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_ad41c998638b0451fed7ad3e46cdad83.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_468c3330ec5a42a27e75f0af3d7bf48b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_468c3330ec5a42a27e75f0af3d7bf48b.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_22be486a491539f7f96f64377b3a54ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_22be486a491539f7f96f64377b3a54ef.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_83f1dc083d0e0cd41cf197af5c2e62ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_83f1dc083d0e0cd41cf197af5c2e62ae.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_81e8e1dd0e5f849b0d65954642835fc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_81e8e1dd0e5f849b0d65954642835fc7.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_dfb6f65edcf3a4a24a7f9b4f95b54f5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_dfb6f65edcf3a4a24a7f9b4f95b54f5a.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_7e8b842431191b1de284a267452b2af4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_7e8b842431191b1de284a267452b2af4.jpg already downloaded
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F33%252F30334cb6589fc4bad32a284b23644e61%252Fpa%252FLG99308_f4a94710d2d97879d6e98d922aabcd23.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_f4a94710d2d97879d6e98d922aabcd23.jpg already downloaded
2026-03-28 20:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c616886c-40cd-54e2-876c-ca245eae83f0, identifier: LG99308
2026-03-28 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_0402b0462cfcad60013f57ff2cec39a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_c4a5200499dd0543ca4766832a8e7241.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_c4a5200499dd0543ca4766832a8e7241.jpg not downloaded yet
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_1b59db2a7713f28bac3414e079816db0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_1b59db2a7713f28bac3414e079816db0.jpg not downloaded yet
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_f5a39b563e9064969e31e9e05a1bbb7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_f5a39b563e9064969e31e9e05a1bbb7f.jpg not downloaded yet
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_37d12c1cdb5f439b82455629bfd05b12.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_37d12c1cdb5f439b82455629bfd05b12.jpg not downloaded yet
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_05d8f33f52cbe25e31ddb12c4913a833.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_05d8f33f52cbe25e31ddb12c4913a833.jpg not downloaded yet
2026-03-28 20:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308
2026-03-28 20:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308
2026-03-28 20:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c616886c-40cd-54e2-876c-ca245eae83f0 with identifier: LG99308 to the API
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG99308>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:26Z',
 'fuel_type': 'diesel',
 'id': 'c616886c-40cd-54e2-876c-ca245eae83f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG99308',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 90061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_fd52e69d4d9b91a16ec960c83b90780f.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_95257dceb251d795e455e26d96cdc776.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_ad41c998638b0451fed7ad3e46cdad83.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_468c3330ec5a42a27e75f0af3d7bf48b.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_22be486a491539f7f96f64377b3a54ef.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_83f1dc083d0e0cd41cf197af5c2e62ae.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_81e8e1dd0e5f849b0d65954642835fc7.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_dfb6f65edcf3a4a24a7f9b4f95b54f5a.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_7e8b842431191b1de284a267452b2af4.jpg',
                'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_f4a94710d2d97879d6e98d922aabcd23.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_fd52e69d4d9b91a16ec960c83b90780f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_95257dceb251d795e455e26d96cdc776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_ad41c998638b0451fed7ad3e46cdad83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_468c3330ec5a42a27e75f0af3d7bf48b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_22be486a491539f7f96f64377b3a54ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_83f1dc083d0e0cd41cf197af5c2e62ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_81e8e1dd0e5f849b0d65954642835fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_dfb6f65edcf3a4a24a7f9b4f95b54f5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_7e8b842431191b1de284a267452b2af4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c616886c-40cd-54e2-876c-ca245eae83f0/c616886c-40cd-54e2-876c-ca245eae83f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/33/30334cb6589fc4bad32a284b23644e61/pa/LG99308_f4a94710d2d97879d6e98d922aabcd23.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super 2WD',
 'transmission': 'automatic',
 'trim': 'Super 2WD',
 'year': 2017}
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [auto1.be] INFO: Saving data for LG99308: {'created_time': 1774730303.931068, 'last_price_update_time': 1774730303.931081, 'auction_closing_time': 1774885526.0}
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LG99308') HTTP/1.1" 204 0
2026-03-28 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_2c5a7d8e81a1ab262f7cd49d8b598c3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_27d6b8a1da010e96d7b0f31e0161758c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_32f1ab91835758f66a02891da2ed289c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_32f1ab91835758f66a02891da2ed289c.jpg not downloaded yet
2026-03-28 20:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_5228300efea45e2e4c0669b840fe244c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_5228300efea45e2e4c0669b840fe244c.jpg not downloaded yet
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_daeb42102e7f5be1db53524e5ab59643.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_daeb42102e7f5be1db53524e5ab59643.jpg not downloaded yet
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_9cf87b86ddb0696defb0b9c0af0769ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_9cf87b86ddb0696defb0b9c0af0769ab.jpg not downloaded yet
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_a0d1b2bed4a3ed8afdb29dfdb58f989e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_a0d1b2bed4a3ed8afdb29dfdb58f989e.jpg not downloaded yet
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80309a750>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_fa695ec2f49c3fa33c953334bc7135ba.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa695ec2f49c3fa33c953334bc7135ba.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80305d650>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_8b4ba21ce02b877c1783ec8e590a97c0.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8b4ba21ce02b877c1783ec8e590a97c0.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803136210>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_2501162210da2464e81f44cc623d92ca.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_2501162210da2464e81f44cc623d92ca.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e96362a5-b7df-5360-9b83-8295d9f087d0
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_1a812747e94b052e9a7ce64d4285c4d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6e768c9d6af521a7a88042e6038f1006.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_1a5eb36b2986ee26cb628389b6630d14.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80305fe10>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_0402b0462cfcad60013f57ff2cec39a9.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_0402b0462cfcad60013f57ff2cec39a9.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802ee7ed0>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_2c5a7d8e81a1ab262f7cd49d8b598c3f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_2c5a7d8e81a1ab262f7cd49d8b598c3f.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f2ead0>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_27d6b8a1da010e96d7b0f31e0161758c.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_27d6b8a1da010e96d7b0f31e0161758c.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_05d8f33f52cbe25e31ddb12c4913a833.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d3b090>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_1a812747e94b052e9a7ce64d4285c4d2.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_1a812747e94b052e9a7ce64d4285c4d2.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e96362a5-b7df-5360-9b83-8295d9f087d0
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d1d410>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_6e768c9d6af521a7a88042e6038f1006.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6e768c9d6af521a7a88042e6038f1006.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d34610>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_1a5eb36b2986ee26cb628389b6630d14.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_1a5eb36b2986ee26cb628389b6630d14.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_cdfca0b36dc905bf1d249d9858dfeef3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_54ee027314057cd8ef86c63eeda422a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c37d4d74e400f16067f9f41779bc773.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b00650>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_05d8f33f52cbe25e31ddb12c4913a833.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_05d8f33f52cbe25e31ddb12c4913a833.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_daeb42102e7f5be1db53524e5ab59643.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_a0d1b2bed4a3ed8afdb29dfdb58f989e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_a2d779c5d16eb0c46f5a53cc1cf6c88b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_8b39e25cf502a48c62156a870f732996.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_1ca605dac51a28dd3617b816697f101f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_32f1ab91835758f66a02891da2ed289c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b01c50>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_cdfca0b36dc905bf1d249d9858dfeef3.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_cdfca0b36dc905bf1d249d9858dfeef3.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b39610>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_54ee027314057cd8ef86c63eeda422a9.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_54ee027314057cd8ef86c63eeda422a9.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b51d90>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_7c37d4d74e400f16067f9f41779bc773.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c37d4d74e400f16067f9f41779bc773.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_9cf87b86ddb0696defb0b9c0af0769ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_37d12c1cdb5f439b82455629bfd05b12.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_5228300efea45e2e4c0669b840fe244c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80301f850>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_daeb42102e7f5be1db53524e5ab59643.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_daeb42102e7f5be1db53524e5ab59643.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce3b50>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_a0d1b2bed4a3ed8afdb29dfdb58f989e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_a0d1b2bed4a3ed8afdb29dfdb58f989e.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80301da90>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_a2d779c5d16eb0c46f5a53cc1cf6c88b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_a2d779c5d16eb0c46f5a53cc1cf6c88b.jpg saved to cache
2026-03-28 20:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ceb1d0>
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_8b39e25cf502a48c62156a870f732996.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_8b39e25cf502a48c62156a870f732996.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce10d0>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_1ca605dac51a28dd3617b816697f101f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_1ca605dac51a28dd3617b816697f101f.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030abcd0>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_32f1ab91835758f66a02891da2ed289c.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_32f1ab91835758f66a02891da2ed289c.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV93881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ47204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031d1e10>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_9cf87b86ddb0696defb0b9c0af0769ab.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_9cf87b86ddb0696defb0b9c0af0769ab.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811dfb690>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_37d12c1cdb5f439b82455629bfd05b12.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_37d12c1cdb5f439b82455629bfd05b12.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030df890>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_5228300efea45e2e4c0669b840fe244c.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_5228300efea45e2e4c0669b840fe244c.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_76ea0bdf7589f944e0169a774ce3ea04.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_c4a5200499dd0543ca4766832a8e7241.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_1b59db2a7713f28bac3414e079816db0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_f5a39b563e9064969e31e9e05a1bbb7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_81571b6ef0f6669ea33b33ae467d3436.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_bc4ede9f160e350fa19f25fc1632e80f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b02090>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_76ea0bdf7589f944e0169a774ce3ea04.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_76ea0bdf7589f944e0169a774ce3ea04.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_c014426572cb367ac8cb4c6a9010d300.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_0728556a1f560250690251b91d71696d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d1c2d0>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_c4a5200499dd0543ca4766832a8e7241.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_c4a5200499dd0543ca4766832a8e7241.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce9d90>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_1b59db2a7713f28bac3414e079816db0.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_1b59db2a7713f28bac3414e079816db0.jpg saved to cache
2026-03-28 20:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803ce0990>
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_f5a39b563e9064969e31e9e05a1bbb7f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_f5a39b563e9064969e31e9e05a1bbb7f.jpg saved to cache
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031f4350>
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_81571b6ef0f6669ea33b33ae467d3436.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_81571b6ef0f6669ea33b33ae467d3436.jpg saved to cache
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b70810>
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_bc4ede9f160e350fa19f25fc1632e80f.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_bc4ede9f160e350fa19f25fc1632e80f.jpg saved to cache
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d2bb50>
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_c014426572cb367ac8cb4c6a9010d300.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_c014426572cb367ac8cb4c6a9010d300.jpg saved to cache
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1c150>
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_0728556a1f560250690251b91d71696d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_0728556a1f560250690251b91d71696d.jpg saved to cache
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6214dce6907b4951e3e5c68470c249d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ76034> (referer: https://www.auto1.com/v1/car-details-view/HZ76034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8f25fb444ba81904f0e4af3dfa81ad21.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_634af0431ba231cc9fae6a4fcef94440.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_8814781f62745897724c4223f0d87145.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_4b8f011bd50e87259b4d4f9f6a5c8210.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_42be3e50ce5140bb5cdde89f51cb37e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803096150>
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_6214dce6907b4951e3e5c68470c249d9.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6214dce6907b4951e3e5c68470c249d9.jpg saved to cache
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa8360ea02b52e604337178001dd0a85.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e39d2ed55e61f75eb55bf4d8060d8fdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_d80b995d8e5be9dd5eb62d1a2993be85.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV93759> (referer: https://www.auto1.com/v1/car-details-view/WV93759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US61524> (referer: https://www.auto1.com/v1/car-details-view/US61524/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ93890> (referer: https://www.auto1.com/v1/car-details-view/WJ93890/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034
2026-03-28 20:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with scrape type 1
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b039c07a-f512-5b0b-9bf7-7c4a27c3aaec
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_307f821424af1b58476a8b4f7abf1433.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_307f821424af1b58476a8b4f7abf1433.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_4c035cfa3c4df079bd7b60dd7ce25970.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_4c035cfa3c4df079bd7b60dd7ce25970.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_41bde7afe9591e3e8dc7c42fb5078ade.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_41bde7afe9591e3e8dc7c42fb5078ade.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_e658075f0af3dd30fd3a4bf462a879c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_e658075f0af3dd30fd3a4bf462a879c0.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_db47df7b0816cd06f9dc53794d7ca81a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_db47df7b0816cd06f9dc53794d7ca81a.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_81c4076c5b5371a49b7145b07618d91e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_81c4076c5b5371a49b7145b07618d91e.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_b2cbd18e2eefaf760ec091f1e5b052b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_b2cbd18e2eefaf760ec091f1e5b052b2.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_f2422cc57ed915e01c38ee1c5eeb105d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_f2422cc57ed915e01c38ee1c5eeb105d.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_26776cc9a8ba483aa1a45a2400874255.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_26776cc9a8ba483aa1a45a2400874255.jpg already downloaded
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F35%252F733546707618bec8c52fb9c4843154e4%252Fpa%252FHZ76034_f70b37e9778561e0e47ee8934ae4d22f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_f70b37e9778561e0e47ee8934ae4d22f.jpg already downloaded
2026-03-28 20:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec, identifier: HZ76034
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fce010>
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_8f25fb444ba81904f0e4af3dfa81ad21.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8f25fb444ba81904f0e4af3dfa81ad21.jpg saved to cache
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803074ad0>
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_634af0431ba231cc9fae6a4fcef94440.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_634af0431ba231cc9fae6a4fcef94440.jpg saved to cache
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d32010>
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_8814781f62745897724c4223f0d87145.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_8814781f62745897724c4223f0d87145.jpg saved to cache
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802feaed0>
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_4b8f011bd50e87259b4d4f9f6a5c8210.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_4b8f011bd50e87259b4d4f9f6a5c8210.jpg saved to cache
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803be6810>
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F73%252Faa734af7582963371e23e4d4f1ff87fd%252Fpa%252FSX16585_42be3e50ce5140bb5cdde89f51cb37e8.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_42be3e50ce5140bb5cdde89f51cb37e8.jpg saved to cache
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7
2026-03-28 20:38:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11b1a499-c6f6-59c7-9938-fb93fcad50f7, skipping ID generation
2026-03-28 20:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with scrape type 1
2026-03-28 20:38:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11b1a499-c6f6-59c7-9938-fb93fcad50f7 sending to next pipeline
2026-03-28 20:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11b1a499-c6f6-59c7-9938-fb93fcad50f7, identifier: SX16585
2026-03-28 20:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_22607338f05f60bf2d8de378ed529dca.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034
2026-03-28 20:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034
2026-03-28 20:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b039c07a-f512-5b0b-9bf7-7c4a27c3aaec with identifier: HZ76034 to the API
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HZ76034>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:15:24Z',
 'fuel_type': 'diesel',
 'id': 'b039c07a-f512-5b0b-9bf7-7c4a27c3aaec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ76034',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 148249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_307f821424af1b58476a8b4f7abf1433.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_4c035cfa3c4df079bd7b60dd7ce25970.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_41bde7afe9591e3e8dc7c42fb5078ade.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_e658075f0af3dd30fd3a4bf462a879c0.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_db47df7b0816cd06f9dc53794d7ca81a.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_81c4076c5b5371a49b7145b07618d91e.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_b2cbd18e2eefaf760ec091f1e5b052b2.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_f2422cc57ed915e01c38ee1c5eeb105d.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_26776cc9a8ba483aa1a45a2400874255.jpg',
                'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_f70b37e9778561e0e47ee8934ae4d22f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_307f821424af1b58476a8b4f7abf1433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_4c035cfa3c4df079bd7b60dd7ce25970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_41bde7afe9591e3e8dc7c42fb5078ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_e658075f0af3dd30fd3a4bf462a879c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_db47df7b0816cd06f9dc53794d7ca81a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_81c4076c5b5371a49b7145b07618d91e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_b2cbd18e2eefaf760ec091f1e5b052b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_f2422cc57ed915e01c38ee1c5eeb105d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_26776cc9a8ba483aa1a45a2400874255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b039c07a-f512-5b0b-9bf7-7c4a27c3aaec/b039c07a-f512-5b0b-9bf7-7c4a27c3aaec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349734,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img73/35/733546707618bec8c52fb9c4843154e4/pa/HZ76034_f70b37e9778561e0e47ee8934ae4d22f.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-28 20:38:27 [auto1.be] INFO: Saving data for HZ76034: {'created_time': 1774730307.654395, 'last_price_update_time': 1774730307.654407, 'auction_closing_time': 1774883724.0}
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ76034') HTTP/1.1" 204 0
2026-03-28 20:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585
2026-03-28 20:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585
2026-03-28 20:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11b1a499-c6f6-59c7-9938-fb93fcad50f7 with identifier: SX16585 to the API
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_42be3e50ce5140bb5cdde89f51cb37e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:39:59Z',
 'fuel_type': 'diesel',
 'id': '11b1a499-c6f6-59c7-9938-fb93fcad50f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX16585',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 117908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c68ad47c116ebe95b906663b3f5c461.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_90b9f43f937bd0afafb4d764ead82e60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_42be3e50ce5140bb5cdde89f51cb37e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8b4ba21ce02b877c1783ec8e590a97c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_8f25fb444ba81904f0e4af3dfa81ad21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_2c5a7d8e81a1ab262f7cd49d8b598c3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_54ee027314057cd8ef86c63eeda422a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_7c37d4d74e400f16067f9f41779bc773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_05d8f33f52cbe25e31ddb12c4913a833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b1a499-c6f6-59c7-9938-fb93fcad50f7/11b1a499-c6f6-59c7-9938-fb93fcad50f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/73/aa734af7582963371e23e4d4f1ff87fd/pa/SX16585_a0d1b2bed4a3ed8afdb29dfdb58f989e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 d Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 20:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [auto1.be] INFO: Saving data for SX16585: {'created_time': 1774730308.004266, 'last_price_update_time': 1774730308.004277, 'auction_closing_time': 1774885199.0}
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX16585') HTTP/1.1" 204 0
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_08bc728d01e3e1c7eff76f13d995f2d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_e4b16cd1feaab8bb673202428ccbb5ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ47204> (referer: https://www.auto1.com/v1/car-details-view/PJ47204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_4d2d7376b77c3bd6d39c46dc302cf8ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f08310>
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_fa8360ea02b52e604337178001dd0a85.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa8360ea02b52e604337178001dd0a85.jpg saved to cache
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b6d950>
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_e39d2ed55e61f75eb55bf4d8060d8fdd.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e39d2ed55e61f75eb55bf4d8060d8fdd.jpg saved to cache
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e96362a5-b7df-5360-9b83-8295d9f087d0
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a72310>
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_d80b995d8e5be9dd5eb62d1a2993be85.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_d80b995d8e5be9dd5eb62d1a2993be85.jpg saved to cache
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759
2026-03-28 20:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with scrape type 1
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_a3fd1cb31dac5e8ae5c9573f712ae801.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_a3fd1cb31dac5e8ae5c9573f712ae801.jpg not downloaded yet
2026-03-28 20:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524
2026-03-28 20:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with scrape type 1
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_0f5889f12660cd3ea307b6693072e30d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0f5889f12660cd3ea307b6693072e30d.jpg not downloaded yet
2026-03-28 20:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890
2026-03-28 20:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5cfa43-494b-591c-8fb6-e53de7c77135 with scrape type 1
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bf5cfa43-494b-591c-8fb6-e53de7c77135
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_bd7aa4277e06694fe6971dd530c8e85e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_bd7aa4277e06694fe6971dd530c8e85e.jpg not downloaded yet
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802fda190>
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_22607338f05f60bf2d8de378ed529dca.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_22607338f05f60bf2d8de378ed529dca.jpg saved to cache
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_72f657a2ed68486185e6dd9377d9ad77.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_72f657a2ed68486185e6dd9377d9ad77.jpg not downloaded yet
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_3f475b7c88ddf1c7299a12e679e19326.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_3f475b7c88ddf1c7299a12e679e19326.jpg not downloaded yet
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_fe2e193831251c46066c6b36c2d9a64a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_fe2e193831251c46066c6b36c2d9a64a.jpg not downloaded yet
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_91be0ca67be46311b943b0fd3ddc5523.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e8060d33ecaf9da18dc96c15a0c316bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_10df7f2e5db217af6acac0f573264c92.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_28ff2b96b7c384a37872d31bfe6ea135.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_28ff2b96b7c384a37872d31bfe6ea135.jpg not downloaded yet
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_c919353eca59cf9fd81bbfcffbeea551.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c919353eca59cf9fd81bbfcffbeea551.jpg not downloaded yet
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_e0d2174863172339457475fe1ee76e02.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_e0d2174863172339457475fe1ee76e02.jpg not downloaded yet
2026-03-28 20:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_3b2bbe5466ea3635cfa080da29c5b21b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030040d0>
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_08bc728d01e3e1c7eff76f13d995f2d3.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_08bc728d01e3e1c7eff76f13d995f2d3.jpg saved to cache
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e96362a5-b7df-5360-9b83-8295d9f087d0
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bb2610>
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_e4b16cd1feaab8bb673202428ccbb5ab.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_e4b16cd1feaab8bb673202428ccbb5ab.jpg saved to cache
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204
2026-03-28 20:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with scrape type 1
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 959327f5-1ae3-5e5a-b260-6aa0fa096f6b
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_ad1124dcd20e9f40a9be87707f6779a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_ad1124dcd20e9f40a9be87707f6779a6.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_7d198f83786febd36dc4feff4d3a20fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_7d198f83786febd36dc4feff4d3a20fc.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_9166a74fc0ee7a036c14f62dd822ddd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_9166a74fc0ee7a036c14f62dd822ddd9.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_f9f0b1d973ef61ecafa9101bce20ad18.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_f9f0b1d973ef61ecafa9101bce20ad18.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_df5a471eec80284762cf2753f6a5cba7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_df5a471eec80284762cf2753f6a5cba7.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_6ba283a9d2889dbae6798193eed0dd6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_6ba283a9d2889dbae6798193eed0dd6b.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_d6964b196d85836360bac0f95c4a304b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_d6964b196d85836360bac0f95c4a304b.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_dffc1f3d3fae7c3fd8741a8ff3cb22d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_dffc1f3d3fae7c3fd8741a8ff3cb22d3.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_10eb685e10f282267052cb416f0faba0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_10eb685e10f282267052cb416f0faba0.jpg already downloaded
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fb6%252F21b60ae307aa3cd9a75be4be4db59764%252Fpa%252FPJ47204_126557e4679820d0d18433149d652f14.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_126557e4679820d0d18433149d652f14.jpg already downloaded
2026-03-28 20:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b, identifier: PJ47204
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803070610>
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_4d2d7376b77c3bd6d39c46dc302cf8ee.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_4d2d7376b77c3bd6d39c46dc302cf8ee.jpg saved to cache
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_1dd92aee6d96b0f5dbf408a3ea9e7ffc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_1dd92aee6d96b0f5dbf408a3ea9e7ffc.jpg not downloaded yet
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_0942569e7d7cfe1b6984818d840ad434.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0942569e7d7cfe1b6984818d840ad434.jpg not downloaded yet
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_a79195dc4261961bf78a33974a101ce6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_a79195dc4261961bf78a33974a101ce6.jpg not downloaded yet
2026-03-28 20:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204
2026-03-28 20:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204
2026-03-28 20:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 959327f5-1ae3-5e5a-b260-6aa0fa096f6b with identifier: PJ47204 to the API
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PJ47204>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:39:31Z',
 'fuel_type': 'diesel',
 'id': '959327f5-1ae3-5e5a-b260-6aa0fa096f6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ47204',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 177376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_ad1124dcd20e9f40a9be87707f6779a6.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_7d198f83786febd36dc4feff4d3a20fc.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_9166a74fc0ee7a036c14f62dd822ddd9.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_f9f0b1d973ef61ecafa9101bce20ad18.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_df5a471eec80284762cf2753f6a5cba7.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_6ba283a9d2889dbae6798193eed0dd6b.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_d6964b196d85836360bac0f95c4a304b.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_dffc1f3d3fae7c3fd8741a8ff3cb22d3.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_10eb685e10f282267052cb416f0faba0.jpg',
                'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_126557e4679820d0d18433149d652f14.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_ad1124dcd20e9f40a9be87707f6779a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_7d198f83786febd36dc4feff4d3a20fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_9166a74fc0ee7a036c14f62dd822ddd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_f9f0b1d973ef61ecafa9101bce20ad18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_df5a471eec80284762cf2753f6a5cba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_6ba283a9d2889dbae6798193eed0dd6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_d6964b196d85836360bac0f95c4a304b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_dffc1f3d3fae7c3fd8741a8ff3cb22d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_10eb685e10f282267052cb416f0faba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959327f5-1ae3-5e5a-b260-6aa0fa096f6b/959327f5-1ae3-5e5a-b260-6aa0fa096f6b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/b6/21b60ae307aa3cd9a75be4be4db59764/pa/PJ47204_126557e4679820d0d18433149d652f14.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 e-HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2013}
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-28 20:38:29 [auto1.be] INFO: Saving data for PJ47204: {'created_time': 1774730309.286503, 'last_price_update_time': 1774730309.286514, 'auction_closing_time': 1774885171.0}
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ47204') HTTP/1.1" 204 0
2026-03-28 20:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0f5889f12660cd3ea307b6693072e30d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_bd7aa4277e06694fe6971dd530c8e85e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_9e59c992056364d9013dc834b3f8ef6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9e59c992056364d9013dc834b3f8ef6c.jpg not downloaded yet
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_dc850235e53648aa39360935eb924596.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_dc850235e53648aa39360935eb924596.jpg not downloaded yet
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_3b0abf88b1e74925a03d23425791560b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_3b0abf88b1e74925a03d23425791560b.jpg not downloaded yet
2026-03-28 20:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV93881> (referer: https://www.auto1.com/v1/car-details-view/WV93881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803079850>
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_91be0ca67be46311b943b0fd3ddc5523.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_91be0ca67be46311b943b0fd3ddc5523.jpg saved to cache
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d0ac10>
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9b%252Ff89bf5db9d413f3ecfb3af68efb206e2%252Fpa%252FMY75694_e8060d33ecaf9da18dc96c15a0c316bd.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e8060d33ecaf9da18dc96c15a0c316bd.jpg saved to cache
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e96362a5-b7df-5360-9b83-8295d9f087d0
2026-03-28 20:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e96362a5-b7df-5360-9b83-8295d9f087d0, skipping ID generation
2026-03-28 20:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96362a5-b7df-5360-9b83-8295d9f087d0 with scrape type 1
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e96362a5-b7df-5360-9b83-8295d9f087d0 sending to next pipeline
2026-03-28 20:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e96362a5-b7df-5360-9b83-8295d9f087d0, identifier: MY75694
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b03a50>
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_10df7f2e5db217af6acac0f573264c92.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_10df7f2e5db217af6acac0f573264c92.jpg saved to cache
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811df3c90>
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fa0%252F28a0fe4bd70ba1591ba874850018fc49%252Fpa%252FHT80629_3b2bbe5466ea3635cfa080da29c5b21b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_3b2bbe5466ea3635cfa080da29c5b21b.jpg saved to cache
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7
2026-03-28 20:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7, skipping ID generation
2026-03-28 20:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with scrape type 1
2026-03-28 20:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 sending to next pipeline
2026-03-28 20:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7, identifier: HT80629
2026-03-28 20:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_a3fd1cb31dac5e8ae5c9573f712ae801.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694
2026-03-28 20:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694
2026-03-28 20:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e96362a5-b7df-5360-9b83-8295d9f087d0 with identifier: MY75694 to the API
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e8060d33ecaf9da18dc96c15a0c316bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:50Z',
 'fuel_type': 'diesel',
 'id': 'e96362a5-b7df-5360-9b83-8295d9f087d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY75694',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 234603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_0a27bb244b309075ec2c5cd2d7e1902a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e8060d33ecaf9da18dc96c15a0c316bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_e39d2ed55e61f75eb55bf4d8060d8fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_2501162210da2464e81f44cc623d92ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_08bc728d01e3e1c7eff76f13d995f2d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96362a5-b7df-5360-9b83-8295d9f087d0/e96362a5-b7df-5360-9b83-8295d9f087d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9b/f89bf5db9d413f3ecfb3af68efb206e2/pa/MY75694_1a812747e94b052e9a7ce64d4285c4d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [auto1.be] INFO: Saving data for MY75694: {'created_time': 1774730310.106781, 'last_price_update_time': 1774730310.106795, 'auction_closing_time': 1774884770.0}
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MY75694') HTTP/1.1" 204 0
2026-03-28 20:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629
2026-03-28 20:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629
2026-03-28 20:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8fba3b0a-d9a3-5ddf-9405-a33004af36f7 with identifier: HT80629 to the API
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_3b2bbe5466ea3635cfa080da29c5b21b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:50:42Z',
 'fuel_type': 'petrol',
 'id': '8fba3b0a-d9a3-5ddf-9405-a33004af36f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT80629',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 53200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_3b2bbe5466ea3635cfa080da29c5b21b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_91be0ca67be46311b943b0fd3ddc5523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_e4b16cd1feaab8bb673202428ccbb5ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_8814781f62745897724c4223f0d87145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_634af0431ba231cc9fae6a4fcef94440.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_1a5eb36b2986ee26cb628389b6630d14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_4b8f011bd50e87259b4d4f9f6a5c8210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_bc4ede9f160e350fa19f25fc1632e80f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2265166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_c4a5200499dd0543ca4766832a8e7241.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fba3b0a-d9a3-5ddf-9405-a33004af36f7/8fba3b0a-d9a3-5ddf-9405-a33004af36f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/a0/28a0fe4bd70ba1591ba874850018fc49/pa/HT80629_32f1ab91835758f66a02891da2ed289c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2014}
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [auto1.be] INFO: Saving data for HT80629: {'created_time': 1774730310.452009, 'last_price_update_time': 1774730310.452022, 'auction_closing_time': 1774885842.0}
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT80629') HTTP/1.1" 204 0
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_9de9f06f314715ed170c397d1fcdd65b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9de9f06f314715ed170c397d1fcdd65b.jpg not downloaded yet
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_c4f9433f5b670bedba30c79fefd2fd29.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c4f9433f5b670bedba30c79fefd2fd29.jpg not downloaded yet
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_4e81b0e1409d0a64ed904709664cba95.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_4e81b0e1409d0a64ed904709664cba95.jpg not downloaded yet
2026-03-28 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_3f475b7c88ddf1c7299a12e679e19326.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_fe2e193831251c46066c6b36c2d9a64a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_72f657a2ed68486185e6dd9377d9ad77.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_40840af5879ee1bb43eef81d0acb03ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_40840af5879ee1bb43eef81d0acb03ef.jpg not downloaded yet
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_0bd79bf96f2fb8fc702c616df5309389.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0bd79bf96f2fb8fc702c616df5309389.jpg not downloaded yet
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f09f10>
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_0f5889f12660cd3ea307b6693072e30d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0f5889f12660cd3ea307b6693072e30d.jpg saved to cache
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b547d0>
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_bd7aa4277e06694fe6971dd530c8e85e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_bd7aa4277e06694fe6971dd530c8e85e.jpg saved to cache
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf5cfa43-494b-591c-8fb6-e53de7c77135
2026-03-28 20:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881
2026-03-28 20:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf7c4402-af64-5c36-832b-26e1e864a31b with scrape type 1
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf7c4402-af64-5c36-832b-26e1e864a31b
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_0a649cc27b8ab0d4dca037b74eb413ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_0a649cc27b8ab0d4dca037b74eb413ae.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_4da8a1234eb744196ce3744ee89c20dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_4da8a1234eb744196ce3744ee89c20dc.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_c5084f4577670799e5776c18c84195de.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_c5084f4577670799e5776c18c84195de.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_01c87b6c8c9413c1e96b661b051650ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_01c87b6c8c9413c1e96b661b051650ff.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_e78e774767ea0424c02a9e988ab9c9b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_e78e774767ea0424c02a9e988ab9c9b0.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_f5c1d82ebf5d2b0c064643db8cf569ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_f5c1d82ebf5d2b0c064643db8cf569ab.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_49b3bca9abfdc7b4ad7f748c42115b02.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_49b3bca9abfdc7b4ad7f748c42115b02.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_1271ecafc8373dd96722e9f07a40fc65.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_1271ecafc8373dd96722e9f07a40fc65.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_f41b51da3bafed236ecf78c1801fd63a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_f41b51da3bafed236ecf78c1801fd63a.jpg already downloaded
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fed%252Fdeeda98d6a0d362f8eb5ea9b434bd080%252Fpa%252FWV93881_554b2b2f765dfafda48187fcc33bc249.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_554b2b2f765dfafda48187fcc33bc249.jpg already downloaded
2026-03-28 20:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf7c4402-af64-5c36-832b-26e1e864a31b, identifier: WV93881
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bfc590>
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_a3fd1cb31dac5e8ae5c9573f712ae801.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_a3fd1cb31dac5e8ae5c9573f712ae801.jpg saved to cache
2026-03-28 20:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_a79195dc4261961bf78a33974a101ce6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_793e912e20f6dbe87183701e08ab209d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_793e912e20f6dbe87183701e08ab209d.jpg not downloaded yet
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_babf5d01805d08d348a9b6c5ecd68b24.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_babf5d01805d08d348a9b6c5ecd68b24.jpg not downloaded yet
2026-03-28 20:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881
2026-03-28 20:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881
2026-03-28 20:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf7c4402-af64-5c36-832b-26e1e864a31b with identifier: WV93881 to the API
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WV93881>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.9L',
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:46:59Z',
 'fuel_type': 'diesel',
 'id': 'bf7c4402-af64-5c36-832b-26e1e864a31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV93881',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 188305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_0a649cc27b8ab0d4dca037b74eb413ae.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_4da8a1234eb744196ce3744ee89c20dc.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_c5084f4577670799e5776c18c84195de.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_01c87b6c8c9413c1e96b661b051650ff.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_e78e774767ea0424c02a9e988ab9c9b0.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_f5c1d82ebf5d2b0c064643db8cf569ab.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_49b3bca9abfdc7b4ad7f748c42115b02.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_1271ecafc8373dd96722e9f07a40fc65.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_f41b51da3bafed236ecf78c1801fd63a.jpg',
                'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_554b2b2f765dfafda48187fcc33bc249.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_0a649cc27b8ab0d4dca037b74eb413ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_4da8a1234eb744196ce3744ee89c20dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_c5084f4577670799e5776c18c84195de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_01c87b6c8c9413c1e96b661b051650ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_e78e774767ea0424c02a9e988ab9c9b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_f5c1d82ebf5d2b0c064643db8cf569ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_49b3bca9abfdc7b4ad7f748c42115b02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_1271ecafc8373dd96722e9f07a40fc65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_f41b51da3bafed236ecf78c1801fd63a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf7c4402-af64-5c36-832b-26e1e864a31b/bf7c4402-af64-5c36-832b-26e1e864a31b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/ed/deeda98d6a0d362f8eb5ea9b434bd080/pa/WV93881_554b2b2f765dfafda48187fcc33bc249.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-28 20:38:31 [auto1.be] INFO: Saving data for WV93881: {'created_time': 1774730311.552316, 'last_price_update_time': 1774730311.552328, 'auction_closing_time': 1774885619.0}
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV93881') HTTP/1.1" 204 0
2026-03-28 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_e0d2174863172339457475fe1ee76e02.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0942569e7d7cfe1b6984818d840ad434.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c919353eca59cf9fd81bbfcffbeea551.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_d045115c9566cb8b9b157e4aea015cc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_d045115c9566cb8b9b157e4aea015cc7.jpg not downloaded yet
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_684521acc72e039741bc1edf96a1d883.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_684521acc72e039741bc1edf96a1d883.jpg not downloaded yet
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8109f3350>
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_3f475b7c88ddf1c7299a12e679e19326.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_3f475b7c88ddf1c7299a12e679e19326.jpg saved to cache
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f50090>
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_fe2e193831251c46066c6b36c2d9a64a.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_fe2e193831251c46066c6b36c2d9a64a.jpg saved to cache
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf5cfa43-494b-591c-8fb6-e53de7c77135
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f090d0>
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_72f657a2ed68486185e6dd9377d9ad77.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_72f657a2ed68486185e6dd9377d9ad77.jpg saved to cache
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_dc850235e53648aa39360935eb924596.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_988cd6f44d23039f6a22d4da202fb561.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_988cd6f44d23039f6a22d4da202fb561.jpg not downloaded yet
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_87f5b4d9309bd9b5e00cd84f4f1be01b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_87f5b4d9309bd9b5e00cd84f4f1be01b.jpg not downloaded yet
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a70190>
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_a79195dc4261961bf78a33974a101ce6.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_a79195dc4261961bf78a33974a101ce6.jpg saved to cache
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf5cfa43-494b-591c-8fb6-e53de7c77135
2026-03-28 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_3b0abf88b1e74925a03d23425791560b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803cebf50>
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_e0d2174863172339457475fe1ee76e02.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_e0d2174863172339457475fe1ee76e02.jpg saved to cache
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf5cfa43-494b-591c-8fb6-e53de7c77135
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b6e510>
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_0942569e7d7cfe1b6984818d840ad434.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0942569e7d7cfe1b6984818d840ad434.jpg saved to cache
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b69d10>
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_c919353eca59cf9fd81bbfcffbeea551.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c919353eca59cf9fd81bbfcffbeea551.jpg saved to cache
2026-03-28 20:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_1dd92aee6d96b0f5dbf408a3ea9e7ffc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9e59c992056364d9013dc834b3f8ef6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_4e81b0e1409d0a64ed904709664cba95.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803c3b610>
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_dc850235e53648aa39360935eb924596.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_dc850235e53648aa39360935eb924596.jpg saved to cache
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b6e890>
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_3b0abf88b1e74925a03d23425791560b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_3b0abf88b1e74925a03d23425791560b.jpg saved to cache
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf5cfa43-494b-591c-8fb6-e53de7c77135
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0bd79bf96f2fb8fc702c616df5309389.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_258f22214b5cd3b84e5134c93b7b3f6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_3f9c59125bcea8f5955aebc61b7d3ecf.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_e05cd659ab6b498790169883db20dba1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_e69f18e338cb2fcd3e1ceb831ba258a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030bbc50>
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_1dd92aee6d96b0f5dbf408a3ea9e7ffc.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_1dd92aee6d96b0f5dbf408a3ea9e7ffc.jpg saved to cache
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_684521acc72e039741bc1edf96a1d883.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80302e350>
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_9e59c992056364d9013dc834b3f8ef6c.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9e59c992056364d9013dc834b3f8ef6c.jpg saved to cache
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_babf5d01805d08d348a9b6c5ecd68b24.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_40840af5879ee1bb43eef81d0acb03ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811de0310>
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F1e%252F371ef63f19014217be6a28858a82dfa5%252Fpa%252FWJ93890_4e81b0e1409d0a64ed904709664cba95.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_4e81b0e1409d0a64ed904709664cba95.jpg saved to cache
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf5cfa43-494b-591c-8fb6-e53de7c77135
2026-03-28 20:38:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf5cfa43-494b-591c-8fb6-e53de7c77135, skipping ID generation
2026-03-28 20:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5cfa43-494b-591c-8fb6-e53de7c77135 with scrape type 1
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf5cfa43-494b-591c-8fb6-e53de7c77135 sending to next pipeline
2026-03-28 20:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf5cfa43-494b-591c-8fb6-e53de7c77135, identifier: WJ93890
2026-03-28 20:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890
2026-03-28 20:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890
2026-03-28 20:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf5cfa43-494b-591c-8fb6-e53de7c77135 with identifier: WJ93890 to the API
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_4e81b0e1409d0a64ed904709664cba95.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'bf5cfa43-494b-591c-8fb6-e53de7c77135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ93890',
 'listing': 'auction',
 'location': 'BE, Ardooie',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 151543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_bd7aa4277e06694fe6971dd530c8e85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_fe2e193831251c46066c6b36c2d9a64a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_e0d2174863172339457475fe1ee76e02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_a79195dc4261961bf78a33974a101ce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_3b0abf88b1e74925a03d23425791560b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf5cfa43-494b-591c-8fb6-e53de7c77135/bf5cfa43-494b-591c-8fb6-e53de7c77135_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/1e/371ef63f19014217be6a28858a82dfa5/pa/WJ93890_4e81b0e1409d0a64ed904709664cba95.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-28 20:38:32 [auto1.be] INFO: Saving data for WJ93890: {'created_time': 1774730312.78887, 'last_price_update_time': 1774730312.788881, 'auction_closing_time': 1774884609.0}
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ93890') HTTP/1.1" 204 0
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9de9f06f314715ed170c397d1fcdd65b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_28ff2b96b7c384a37872d31bfe6ea135.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_793e912e20f6dbe87183701e08ab209d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031ca750>
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_0bd79bf96f2fb8fc702c616df5309389.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0bd79bf96f2fb8fc702c616df5309389.jpg saved to cache
2026-03-28 20:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031dfbd0>
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_258f22214b5cd3b84e5134c93b7b3f6e.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_258f22214b5cd3b84e5134c93b7b3f6e.jpg saved to cache
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe812b56590>
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F96%252F279691cec08949a36f13d18a14e1a6e3%252Fpa%252FWC19794_3f9c59125bcea8f5955aebc61b7d3ecf.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_3f9c59125bcea8f5955aebc61b7d3ecf.jpg saved to cache
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c904cb93-d0db-589e-806e-6cd84b372f27
2026-03-28 20:38:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c904cb93-d0db-589e-806e-6cd84b372f27, skipping ID generation
2026-03-28 20:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c904cb93-d0db-589e-806e-6cd84b372f27 with scrape type 1
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c904cb93-d0db-589e-806e-6cd84b372f27 sending to next pipeline
2026-03-28 20:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c904cb93-d0db-589e-806e-6cd84b372f27, identifier: WC19794
2026-03-28 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031ca750>
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F6e%252Fd66e35993457e539e1d758e5a895083e%252Fpa%252FTF49476_e05cd659ab6b498790169883db20dba1.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_e05cd659ab6b498790169883db20dba1.jpg saved to cache
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22baa273-e520-5500-a7b4-d64af948f4c5
2026-03-28 20:38:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22baa273-e520-5500-a7b4-d64af948f4c5, skipping ID generation
2026-03-28 20:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22baa273-e520-5500-a7b4-d64af948f4c5 with scrape type 1
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22baa273-e520-5500-a7b4-d64af948f4c5 sending to next pipeline
2026-03-28 20:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 22baa273-e520-5500-a7b4-d64af948f4c5, identifier: TF49476
2026-03-28 20:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a6e710>
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F59%252Fc5596ed6990a6478ff6e1fe0b81ecdb3%252Fpa%252FKW17867_e69f18e338cb2fcd3e1ceb831ba258a0.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_e69f18e338cb2fcd3e1ceb831ba258a0.jpg saved to cache
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94b82520-6582-5f7a-9216-1dec75494356
2026-03-28 20:38:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b82520-6582-5f7a-9216-1dec75494356, skipping ID generation
2026-03-28 20:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b82520-6582-5f7a-9216-1dec75494356 with scrape type 1
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94b82520-6582-5f7a-9216-1dec75494356 sending to next pipeline
2026-03-28 20:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94b82520-6582-5f7a-9216-1dec75494356, identifier: KW17867
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803029250>
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_684521acc72e039741bc1edf96a1d883.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_684521acc72e039741bc1edf96a1d883.jpg saved to cache
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a6d250>
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_babf5d01805d08d348a9b6c5ecd68b24.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_babf5d01805d08d348a9b6c5ecd68b24.jpg saved to cache
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bb6510>
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_40840af5879ee1bb43eef81d0acb03ef.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_40840af5879ee1bb43eef81d0acb03ef.jpg saved to cache
2026-03-28 20:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794
2026-03-28 20:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794
2026-03-28 20:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c904cb93-d0db-589e-806e-6cd84b372f27 with identifier: WC19794 to the API
2026-03-28 20:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_3f9c59125bcea8f5955aebc61b7d3ecf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:44:13Z',
 'fuel_type': 'diesel',
 'id': 'c904cb93-d0db-589e-806e-6cd84b372f27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC19794',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 134240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_a1f5f4bff34f01ff1a4cf2e8d81c5b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_4d2d7376b77c3bd6d39c46dc302cf8ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520229,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_3f9c59125bcea8f5955aebc61b7d3ecf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa695ec2f49c3fa33c953334bc7135ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_fa8360ea02b52e604337178001dd0a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_27d6b8a1da010e96d7b0f31e0161758c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2358442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_76ea0bdf7589f944e0169a774ce3ea04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_81571b6ef0f6669ea33b33ae467d3436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633621,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_f5a39b563e9064969e31e9e05a1bbb7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c904cb93-d0db-589e-806e-6cd84b372f27/c904cb93-d0db-589e-806e-6cd84b372f27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/96/279691cec08949a36f13d18a14e1a6e3/pa/WC19794_daeb42102e7f5be1db53524e5ab59643.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-28 20:38:34 [auto1.be] INFO: Saving data for WC19794: {'created_time': 1774730314.246153, 'last_price_update_time': 1774730314.246166, 'auction_closing_time': 1774885453.0}
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC19794') HTTP/1.1" 204 0
2026-03-28 20:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476
2026-03-28 20:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476
2026-03-28 20:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 22baa273-e520-5500-a7b4-d64af948f4c5 with identifier: TF49476 to the API
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_e05cd659ab6b498790169883db20dba1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:52:21Z',
 'fuel_type': 'petrol',
 'id': '22baa273-e520-5500-a7b4-d64af948f4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF49476',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 157587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2568120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_a2d779c5d16eb0c46f5a53cc1cf6c88b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_10df7f2e5db217af6acac0f573264c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_e05cd659ab6b498790169883db20dba1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_0402b0462cfcad60013f57ff2cec39a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_d80b995d8e5be9dd5eb62d1a2993be85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6e768c9d6af521a7a88042e6038f1006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2110442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_6214dce6907b4951e3e5c68470c249d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_c014426572cb367ac8cb4c6a9010d300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_1b59db2a7713f28bac3414e079816db0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22baa273-e520-5500-a7b4-d64af948f4c5/22baa273-e520-5500-a7b4-d64af948f4c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/6e/d66e35993457e539e1d758e5a895083e/pa/TF49476_5228300efea45e2e4c0669b840fe244c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2015}
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-28 20:38:34 [auto1.be] INFO: Saving data for TF49476: {'created_time': 1774730314.605331, 'last_price_update_time': 1774730314.605342, 'auction_closing_time': 1774885941.0}
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF49476') HTTP/1.1" 204 0
2026-03-28 20:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867
2026-03-28 20:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867
2026-03-28 20:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94b82520-6582-5f7a-9216-1dec75494356 with identifier: KW17867 to the API
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_e69f18e338cb2fcd3e1ceb831ba258a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:39:25Z',
 'fuel_type': 'petrol',
 'id': '94b82520-6582-5f7a-9216-1dec75494356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW17867',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 138871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_bd2c5f8526a292966604bdef61786930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_e69f18e338cb2fcd3e1ceb831ba258a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_22607338f05f60bf2d8de378ed529dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_1ca605dac51a28dd3617b816697f101f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778092,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_258f22214b5cd3b84e5134c93b7b3f6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_8b39e25cf502a48c62156a870f732996.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_cdfca0b36dc905bf1d249d9858dfeef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_0728556a1f560250690251b91d71696d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_37d12c1cdb5f439b82455629bfd05b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b82520-6582-5f7a-9216-1dec75494356/94b82520-6582-5f7a-9216-1dec75494356_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/59/c5596ed6990a6478ff6e1fe0b81ecdb3/pa/KW17867_9cf87b86ddb0696defb0b9c0af0769ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2019}
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-28 20:38:34 [auto1.be] INFO: Saving data for KW17867: {'created_time': 1774730314.966894, 'last_price_update_time': 1774730314.966904, 'auction_closing_time': 1774885165.0}
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW17867') HTTP/1.1" 204 0
2026-03-28 20:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_d045115c9566cb8b9b157e4aea015cc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a6f510>
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_9de9f06f314715ed170c397d1fcdd65b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9de9f06f314715ed170c397d1fcdd65b.jpg saved to cache
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8031b3710>
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_28ff2b96b7c384a37872d31bfe6ea135.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_28ff2b96b7c384a37872d31bfe6ea135.jpg saved to cache
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80314f210>
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_793e912e20f6dbe87183701e08ab209d.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_793e912e20f6dbe87183701e08ab209d.jpg saved to cache
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:38:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:38:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:38:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:38:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030f7650>
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_d045115c9566cb8b9b157e4aea015cc7.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_d045115c9566cb8b9b157e4aea015cc7.jpg saved to cache
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c4f9433f5b670bedba30c79fefd2fd29.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_87f5b4d9309bd9b5e00cd84f4f1be01b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_988cd6f44d23039f6a22d4da202fb561.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:38:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe8030f5290>
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_c4f9433f5b670bedba30c79fefd2fd29.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c4f9433f5b670bedba30c79fefd2fd29.jpg saved to cache
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b0cf90>
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fe4%252Feae43d1963fb009594746aa21c2c7f0c%252Fpa%252FUS61524_87f5b4d9309bd9b5e00cd84f4f1be01b.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_87f5b4d9309bd9b5e00cd84f4f1be01b.jpg saved to cache
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf
2026-03-28 20:38:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf, skipping ID generation
2026-03-28 20:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with scrape type 1
2026-03-28 20:38:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf sending to next pipeline
2026-03-28 20:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf, identifier: US61524
2026-03-28 20:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524
2026-03-28 20:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524
2026-03-28 20:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ebf81c9-5e15-5caa-8e88-c09d21ffebaf with identifier: US61524 to the API
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_87f5b4d9309bd9b5e00cd84f4f1be01b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:01:18Z',
 'fuel_type': 'petrol',
 'id': '6ebf81c9-5e15-5caa-8e88-c09d21ffebaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US61524',
 'listing': 'auction',
 'location': 'BE, Wommelgem',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 103049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0f5889f12660cd3ea307b6693072e30d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_3f475b7c88ddf1c7299a12e679e19326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c919353eca59cf9fd81bbfcffbeea551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0942569e7d7cfe1b6984818d840ad434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_dc850235e53648aa39360935eb924596.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1922630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_c4f9433f5b670bedba30c79fefd2fd29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_0bd79bf96f2fb8fc702c616df5309389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_babf5d01805d08d348a9b6c5ecd68b24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_684521acc72e039741bc1edf96a1d883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebf81c9-5e15-5caa-8e88-c09d21ffebaf/6ebf81c9-5e15-5caa-8e88-c09d21ffebaf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1930204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/e4/eae43d1963fb009594746aa21c2c7f0c/pa/US61524_87f5b4d9309bd9b5e00cd84f4f1be01b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2012}
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [auto1.be] INFO: Saving data for US61524: {'created_time': 1774730316.029871, 'last_price_update_time': 1774730316.029883, 'auction_closing_time': 1774882878.0}
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='US61524') HTTP/1.1" 204 0
2026-03-28 20:38:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811eb9310>
2026-03-28 20:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F02%252Fa40241e7a62542a7a6460d3f99f6bc20%252Fpa%252FWV93759_988cd6f44d23039f6a22d4da202fb561.jpg') HTTP/1.1" 204 0
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_988cd6f44d23039f6a22d4da202fb561.jpg saved to cache
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5
2026-03-28 20:38:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5, skipping ID generation
2026-03-28 20:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with scrape type 1
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 sending to next pipeline
2026-03-28 20:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5, identifier: WV93759
2026-03-28 20:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759
2026-03-28 20:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759
2026-03-28 20:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 871dfe9d-1abf-5afc-8f0f-35fc3a0153c5 with identifier: WV93759 to the API
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_988cd6f44d23039f6a22d4da202fb561.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'petrol',
 'id': '871dfe9d-1abf-5afc-8f0f-35fc3a0153c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV93759',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 137459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_a3fd1cb31dac5e8ae5c9573f712ae801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_72f657a2ed68486185e6dd9377d9ad77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_28ff2b96b7c384a37872d31bfe6ea135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_1dd92aee6d96b0f5dbf408a3ea9e7ffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9e59c992056364d9013dc834b3f8ef6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_9de9f06f314715ed170c397d1fcdd65b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_40840af5879ee1bb43eef81d0acb03ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_793e912e20f6dbe87183701e08ab209d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_d045115c9566cb8b9b157e4aea015cc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_871dfe9d-1abf-5afc-8f0f-35fc3a0153c5/871dfe9d-1abf-5afc-8f0f-35fc3a0153c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/02/a40241e7a62542a7a6460d3f99f6bc20/pa/WV93759_988cd6f44d23039f6a22d4da202fb561.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [auto1.be] INFO: Saving data for WV93759: {'created_time': 1774730316.558567, 'last_price_update_time': 1774730316.558581, 'auction_closing_time': 1774886163.0}
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV93759') HTTP/1.1" 204 0
2026-03-28 20:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG38275> (referer: https://www.auto1.com/v1/car-details-view/WG38275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275
2026-03-28 20:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1add7b67-ee09-5549-b8ef-1df57d6a7640 with scrape type 1
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1add7b67-ee09-5549-b8ef-1df57d6a7640
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_44adb0b5cd1fde30c97419ec3ce198b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_44adb0b5cd1fde30c97419ec3ce198b0.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_383d9b99067f36296cfaba668882b48c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_383d9b99067f36296cfaba668882b48c.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_0ddefc596305d0b3bd1baa6bab7c1a5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_0ddefc596305d0b3bd1baa6bab7c1a5f.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_a99cba43f9ae858367d7ef6bd6870592.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_a99cba43f9ae858367d7ef6bd6870592.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_c93c3bfe9225e92a35e22bdb4c4b6362.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_c93c3bfe9225e92a35e22bdb4c4b6362.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_8b7f5703753d1e153e56991d6004c02a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_8b7f5703753d1e153e56991d6004c02a.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_bf79f93554b0dc5329681119fef4a161.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_bf79f93554b0dc5329681119fef4a161.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_83a96ec202c9b783b8ab340b90884336.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_83a96ec202c9b783b8ab340b90884336.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_b90dfe567576be96c138f561d62bee74.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_b90dfe567576be96c138f561d62bee74.jpg already downloaded
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fab%252F53ab7e241f840f1460f905a281400ed0%252Fpa%252FWG38275_f7f2cd77323efebd3d6233fe32d33f9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_f7f2cd77323efebd3d6233fe32d33f9c.jpg already downloaded
2026-03-28 20:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1add7b67-ee09-5549-b8ef-1df57d6a7640, identifier: WG38275
2026-03-28 20:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275
2026-03-28 20:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275
2026-03-28 20:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1add7b67-ee09-5549-b8ef-1df57d6a7640 with identifier: WG38275 to the API
2026-03-28 20:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG38275>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:19Z',
 'fuel_type': 'diesel',
 'id': '1add7b67-ee09-5549-b8ef-1df57d6a7640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG38275',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 160029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_44adb0b5cd1fde30c97419ec3ce198b0.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_383d9b99067f36296cfaba668882b48c.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_0ddefc596305d0b3bd1baa6bab7c1a5f.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_a99cba43f9ae858367d7ef6bd6870592.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_c93c3bfe9225e92a35e22bdb4c4b6362.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_8b7f5703753d1e153e56991d6004c02a.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_bf79f93554b0dc5329681119fef4a161.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_83a96ec202c9b783b8ab340b90884336.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_b90dfe567576be96c138f561d62bee74.jpg',
                'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_f7f2cd77323efebd3d6233fe32d33f9c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_44adb0b5cd1fde30c97419ec3ce198b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_383d9b99067f36296cfaba668882b48c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_0ddefc596305d0b3bd1baa6bab7c1a5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_a99cba43f9ae858367d7ef6bd6870592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_c93c3bfe9225e92a35e22bdb4c4b6362.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_8b7f5703753d1e153e56991d6004c02a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_bf79f93554b0dc5329681119fef4a161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_83a96ec202c9b783b8ab340b90884336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_b90dfe567576be96c138f561d62bee74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1add7b67-ee09-5549-b8ef-1df57d6a7640/1add7b67-ee09-5549-b8ef-1df57d6a7640_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ab/53ab7e241f840f1460f905a281400ed0/pa/WG38275_f7f2cd77323efebd3d6233fe32d33f9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
 'transmission': 'manual',
 'trim': 'Style blue 2WD',
 'year': 2018}
2026-03-28 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-28 20:38:37 [auto1.be] INFO: Saving data for WG38275: {'created_time': 1774730317.315221, 'last_price_update_time': 1774730317.315238, 'auction_closing_time': 1774883359.0}
2026-03-28 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG38275') HTTP/1.1" 204 0
2026-03-28 20:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN00999> (referer: https://www.auto1.com/v1/car-details-view/DN00999/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999
2026-03-28 20:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f14dc5-80b1-5f56-9057-112117330efe with scrape type 1
2026-03-28 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2f14dc5-80b1-5f56-9057-112117330efe
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_5de010abead698caf123fb324d5aecc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_5de010abead698caf123fb324d5aecc9.jpg already downloaded
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_fa04bd069d3f063ac17a019bf439016e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_fa04bd069d3f063ac17a019bf439016e.jpg already downloaded
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_2f905470d19b44eea4991943c517c98a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_2f905470d19b44eea4991943c517c98a.jpg already downloaded
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_e4bec72baa1e7cad36d0a576ed7bd653.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_e4bec72baa1e7cad36d0a576ed7bd653.jpg already downloaded
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_d18fa1e833b7347361e4b5be008280b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_d18fa1e833b7347361e4b5be008280b2.jpg already downloaded
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_27c8c479c2936f67c57ad20887aec846.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_27c8c479c2936f67c57ad20887aec846.jpg already downloaded
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_ba8ad0bd4f29639b198fe67bf80da2e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_ba8ad0bd4f29639b198fe67bf80da2e5.jpg already downloaded
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_71cbdec9df0a50ad78499070bc836708.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_71cbdec9df0a50ad78499070bc836708.jpg already downloaded
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_ae6bf71278fe78e15468e18ead2c2bd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_ae6bf71278fe78e15468e18ead2c2bd0.jpg already downloaded
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F99%252Fef99262a7abffa11f63717cc5dca5939%252Fpa%252FDN00999_7e806892bef998ba9a97ec1603885570.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_7e806892bef998ba9a97ec1603885570.jpg already downloaded
2026-03-28 20:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2f14dc5-80b1-5f56-9057-112117330efe, identifier: DN00999
2026-03-28 20:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999
2026-03-28 20:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999
2026-03-28 20:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2f14dc5-80b1-5f56-9057-112117330efe with identifier: DN00999 to the API
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN00999>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'petrol',
 'id': 'c2f14dc5-80b1-5f56-9057-112117330efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN00999',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 125327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_5de010abead698caf123fb324d5aecc9.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_fa04bd069d3f063ac17a019bf439016e.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_2f905470d19b44eea4991943c517c98a.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_e4bec72baa1e7cad36d0a576ed7bd653.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_d18fa1e833b7347361e4b5be008280b2.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_27c8c479c2936f67c57ad20887aec846.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_ba8ad0bd4f29639b198fe67bf80da2e5.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_71cbdec9df0a50ad78499070bc836708.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_ae6bf71278fe78e15468e18ead2c2bd0.jpg',
                'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_7e806892bef998ba9a97ec1603885570.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_5de010abead698caf123fb324d5aecc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_fa04bd069d3f063ac17a019bf439016e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_2f905470d19b44eea4991943c517c98a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_e4bec72baa1e7cad36d0a576ed7bd653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_d18fa1e833b7347361e4b5be008280b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_27c8c479c2936f67c57ad20887aec846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_ba8ad0bd4f29639b198fe67bf80da2e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_71cbdec9df0a50ad78499070bc836708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_ae6bf71278fe78e15468e18ead2c2bd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f14dc5-80b1-5f56-9057-112117330efe/c2f14dc5-80b1-5f56-9057-112117330efe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/99/ef99262a7abffa11f63717cc5dca5939/pa/DN00999_7e806892bef998ba9a97ec1603885570.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 UEFA Euro 2016",
 'transmission': 'manual',
 'trim': 'UEFA Euro 2016',
 'year': 2015}
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-28 20:38:58 [auto1.be] INFO: Saving data for DN00999: {'created_time': 1774730338.523307, 'last_price_update_time': 1774730338.523319, 'auction_closing_time': 1774886275.0}
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DN00999') HTTP/1.1" 204 0
2026-03-28 20:39:06 [scrapy.extensions.logstats] INFO: Crawled 176 pages (at 24 pages/min), scraped 135 items (at 30 items/min)
2026-03-28 20:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-28 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF30779> (referer: https://www.auto1.com/v1/car-details-view/CF30779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779
2026-03-28 20:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 846b5e02-6831-5198-99db-401c2272aa06 with scrape type 1
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_c38dbeecef6f36b3ece36cb3bf84a1d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c38dbeecef6f36b3ece36cb3bf84a1d4.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_577323012655c87037bbf04cc91ee7a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_577323012655c87037bbf04cc91ee7a9.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_f16e08550df988f4c34160e727e89d81.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_f16e08550df988f4c34160e727e89d81.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_23471df73e10f6cce020f5067cccb67a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_23471df73e10f6cce020f5067cccb67a.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_0d90799bc66214b5a850dd5b883d9166.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0d90799bc66214b5a850dd5b883d9166.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_e2426d1b5dbaf967eb651ba303547628.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_e2426d1b5dbaf967eb651ba303547628.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_5bea82b9a993dd4d1f05a12eb012190b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_5bea82b9a993dd4d1f05a12eb012190b.jpg not downloaded yet
2026-03-28 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c38dbeecef6f36b3ece36cb3bf84a1d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_c1faf556c210e2f23c5e594d18bf7089.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c1faf556c210e2f23c5e594d18bf7089.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_0ce59fd8c8509a1bc0f619c1f1d0e07d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0ce59fd8c8509a1bc0f619c1f1d0e07d.jpg not downloaded yet
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_53fbfebaf144947181e3f18028fb5dc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_53fbfebaf144947181e3f18028fb5dc3.jpg not downloaded yet
2026-03-28 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0d90799bc66214b5a850dd5b883d9166.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_e2426d1b5dbaf967eb651ba303547628.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803015f90>
2026-03-28 20:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_c38dbeecef6f36b3ece36cb3bf84a1d4.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c38dbeecef6f36b3ece36cb3bf84a1d4.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c1faf556c210e2f23c5e594d18bf7089.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_577323012655c87037bbf04cc91ee7a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_f16e08550df988f4c34160e727e89d81.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_23471df73e10f6cce020f5067cccb67a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802f1fe10>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_0d90799bc66214b5a850dd5b883d9166.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0d90799bc66214b5a850dd5b883d9166.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe80305a610>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_e2426d1b5dbaf967eb651ba303547628.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_e2426d1b5dbaf967eb651ba303547628.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_53fbfebaf144947181e3f18028fb5dc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_5bea82b9a993dd4d1f05a12eb012190b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0ce59fd8c8509a1bc0f619c1f1d0e07d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b0f950>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_c1faf556c210e2f23c5e594d18bf7089.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c1faf556c210e2f23c5e594d18bf7089.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803b0c850>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_577323012655c87037bbf04cc91ee7a9.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_577323012655c87037bbf04cc91ee7a9.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe811b1b190>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_f16e08550df988f4c34160e727e89d81.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_f16e08550df988f4c34160e727e89d81.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe812546d10>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_23471df73e10f6cce020f5067cccb67a.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_23471df73e10f6cce020f5067cccb67a.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe802d1cc10>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_53fbfebaf144947181e3f18028fb5dc3.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_53fbfebaf144947181e3f18028fb5dc3.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803bb4a10>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_5bea82b9a993dd4d1f05a12eb012190b.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_5bea82b9a993dd4d1f05a12eb012190b.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe803a43950>
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fca%252F5bcae0a6620b4fdcb843dbf696e72be2%252Fpa%252FCF30779_0ce59fd8c8509a1bc0f619c1f1d0e07d.jpg') HTTP/1.1" 204 0
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0ce59fd8c8509a1bc0f619c1f1d0e07d.jpg saved to cache
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 846b5e02-6831-5198-99db-401c2272aa06
2026-03-28 20:39:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 846b5e02-6831-5198-99db-401c2272aa06, skipping ID generation
2026-03-28 20:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 846b5e02-6831-5198-99db-401c2272aa06 with scrape type 1
2026-03-28 20:39:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 846b5e02-6831-5198-99db-401c2272aa06 sending to next pipeline
2026-03-28 20:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 846b5e02-6831-5198-99db-401c2272aa06, identifier: CF30779
2026-03-28 20:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779
2026-03-28 20:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779
2026-03-28 20:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 846b5e02-6831-5198-99db-401c2272aa06 with identifier: CF30779 to the API
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0ce59fd8c8509a1bc0f619c1f1d0e07d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:25:17Z',
 'fuel_type': 'diesel',
 'id': '846b5e02-6831-5198-99db-401c2272aa06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF30779',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 230633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c38dbeecef6f36b3ece36cb3bf84a1d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_577323012655c87037bbf04cc91ee7a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_f16e08550df988f4c34160e727e89d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_23471df73e10f6cce020f5067cccb67a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0d90799bc66214b5a850dd5b883d9166.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_e2426d1b5dbaf967eb651ba303547628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_5bea82b9a993dd4d1f05a12eb012190b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_c1faf556c210e2f23c5e594d18bf7089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_0ce59fd8c8509a1bc0f619c1f1d0e07d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_846b5e02-6831-5198-99db-401c2272aa06/846b5e02-6831-5198-99db-401c2272aa06_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/ca/5bcae0a6620b4fdcb843dbf696e72be2/pa/CF30779_53fbfebaf144947181e3f18028fb5dc3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi XTR',
 'transmission': 'manual',
 'trim': 'XTR',
 'year': 2014}
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-28 20:39:09 [auto1.be] INFO: Saving data for CF30779: {'created_time': 1774730349.904514, 'last_price_update_time': 1774730349.904528, 'auction_closing_time': 1774884317.0}
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CF30779') HTTP/1.1" 204 0
2026-03-28 20:39:09 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 20:39:09 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-28 20:39:09 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-28 20:39:10 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (136 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-28T20_35_00.jl
2026-03-28 20:39:10 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 953589,
 'downloader/request_count': 545,
 'downloader/request_method_count/GET': 514,
 'downloader/request_method_count/POST': 31,
 'downloader/response_bytes': 179806632,
 'downloader/response_count': 545,
 'downloader/response_status_count/200': 545,
 'dupefilter/filtered': 9,
 'elapsed_time_seconds': 243.034322,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 20, 39, 10, 14622, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 136,
 'log_count/DEBUG': 5733,
 'log_count/INFO': 5812,
 'memusage/max': 199081984,
 'memusage/startup': 150196224,
 'photo_download_count': 368,
 'request_depth_max': 32,
 'response_received_count': 177,
 'scheduler/dequeued': 545,
 'scheduler/dequeued/memory': 545,
 'scheduler/enqueued': 545,
 'scheduler/enqueued/memory': 545,
 'scrape_type/batch_skipped': 579,
 'scrape_type/new': 72,
 'scrape_type/price_update': 64,
 'scrape_type/skipped': 410,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 177,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.5524101947055393,
 'scrapy-zyte-api/mean_response_seconds': 3.5795187115232525,
 'scrapy-zyte-api/processed': 177,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 177,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 176,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 177,
 'scrapy-zyte-api/request_args/httpRequestBody': 31,
 'scrapy-zyte-api/request_args/httpRequestMethod': 31,
 'scrapy-zyte-api/request_args/httpResponseBody': 177,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 177,
 'scrapy-zyte-api/request_args/sessionContext': 177,
 'scrapy-zyte-api/request_args/url': 177,
 'scrapy-zyte-api/status_codes/200': 177,
 'scrapy-zyte-api/success': 177,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1134,
 'source/total_available': 1094,
 'start_time': datetime.datetime(2026, 3, 28, 20, 35, 6, 980300, tzinfo=datetime.timezone.utc)}
2026-03-28 20:39:10 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 20:39:10 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe811cb7850>
2026-03-28 20:39:10 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe811c88310>